2019-11-27T14:34:43.391 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-27T14:34:43.392 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.Gm0ByV.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi --block --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447 2019-11-27T14:34:43.435 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T14:34:43.502 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447 branch: wip-mkogan-testing description: rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: mkogan@redhat.com first_in_suite: false job_id: '4547447' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-mkogan-testing ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mkogan-testing sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 owner: scheduled_mkogan@teuthology priority: 90 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 suite: rgw:verify suite_branch: wip-mkogan-testing suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.4309 2019-11-27T14:34:43.503 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa; will attempt to use it 2019-11-27T14:34:43.503 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks 2019-11-27T14:34:43.503 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-27T14:34:43.505 INFO:teuthology.task.internal:Checking packages... 2019-11-27T14:34:43.517 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '00732956b62306ff37a7f7c81af9db807aae2dc8' 2019-11-27T14:34:43.517 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-27T14:34:43.517 INFO:teuthology.packaging:ref: None 2019-11-27T14:34:43.517 INFO:teuthology.packaging:tag: None 2019-11-27T14:34:43.518 INFO:teuthology.packaging:branch: wip-mkogan-testing 2019-11-27T14:34:43.518 INFO:teuthology.packaging:sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T14:34:43.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-mkogan-testing 2019-11-27T14:34:43.681 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7725.g0073295 2019-11-27T14:34:43.681 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-27T14:34:43.703 INFO:teuthology.task.internal:no buildpackages task found 2019-11-27T14:34:43.703 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-27T14:34:43.751 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-27T14:34:43.751 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T14:34:43.801 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:34:53.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:03.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:13.842 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:23.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:33.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:43.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:35:53.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:03.926 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:13.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:23.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:33.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:43.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:36:53.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:04.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:14.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:24.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:34.060 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:44.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:37:54.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:04.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:14.119 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:24.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:34.147 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:44.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:38:54.176 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:39:04.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-27T14:39:14.211 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_mkogan@teuthology', 'description': '/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447', 'machine_type': 'smithi'} 2019-11-27T14:39:14.228 DEBUG:teuthology.lock.ops:locked ubuntu@smithi156.front.sepia.ceph.com, ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:39:15.479 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-27T14:39:15.668 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 7.6 2019-11-27T14:39:15.670 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 7.6 2019-11-27T14:39:15.981 INFO:teuthology.orchestra.console:Power off smithi156 2019-11-27T14:39:15.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-27T14:39:16.031 INFO:teuthology.orchestra.console:Power off smithi003 2019-11-27T14:39:16.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-27T14:39:16.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:16.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:16.210 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2019-11-27T14:39:16.226 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2019-11-27T14:39:16.311 INFO:teuthology.orchestra.console:Power on smithi156 2019-11-27T14:39:16.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-27T14:39:16.338 INFO:teuthology.orchestra.console:Power on smithi003 2019-11-27T14:39:16.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-27T14:39:16.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:16.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:20.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:20.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:24.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:24.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-27T14:39:24.782 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2019-11-27T14:39:24.806 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2019-11-27T14:39:24.882 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2019-11-27T14:39:24.907 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2019-11-27T14:41:40.631 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:41:49.710 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:41:55.685 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:41:55.792 ERROR:teuthology.orchestra.connection:Error connecting to smithi156.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 437, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 749, in _auth raise saved_exception AuthenticationException: Authentication failed. 2019-11-27T14:41:58.761 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:42:07.817 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:42:16.873 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:42:25.930 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:43:02.796 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:43:33.477 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:43:33.711 INFO:teuthology.orchestra.run.smithi003:> hostname 2019-11-27T14:43:34.256 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2019-11-27T14:43:34.257 INFO:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2019-11-27T14:43:34.343 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2019-11-27T14:43:34.343 INFO:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2019-11-27T14:43:34.495 INFO:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2019-11-27T14:43:34.589 INFO:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2019-11-27T14:43:34.682 INFO:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2019-11-27T14:43:34.772 INFO:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2019-11-27T14:43:34.848 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2019-11-27T14:43:34.850 DEBUG:teuthology.parallel:result is None 2019-11-27T14:44:08.798 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:44:09.000 INFO:teuthology.orchestra.run.smithi156:> hostname 2019-11-27T14:44:09.567 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2019-11-27T14:44:09.568 INFO:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2019-11-27T14:44:09.665 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2019-11-27T14:44:09.666 INFO:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2019-11-27T14:44:09.800 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2019-11-27T14:44:09.886 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2019-11-27T14:44:09.961 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2019-11-27T14:44:10.033 INFO:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2019-11-27T14:44:10.098 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2019-11-27T14:44:10.100 DEBUG:teuthology.parallel:result is None 2019-11-27T14:44:10.292 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2019-11-27T14:44:10.293 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-27T14:44:10.310 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2019-11-27T14:44:10.310 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-27T14:44:10.325 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2019-11-27T14:44:10.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:44:10.325 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:44:10.411 INFO:teuthology.orchestra.run.smithi156:> true 2019-11-27T14:44:10.822 INFO:teuthology.orchestra.run.smithi156:> uname -m 2019-11-27T14:44:10.888 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2019-11-27T14:44:10.889 INFO:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2019-11-27T14:44:10.949 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Linux" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="7 (Core)" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="7" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2019-11-27T14:44:10.950 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T14:44:10.951 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T14:44:10.952 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:10.952 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2019-11-27T14:44:10.965 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2019-11-27T14:44:10.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:44:10.966 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:44:11.067 INFO:teuthology.orchestra.run.smithi003:> true 2019-11-27T14:44:11.489 INFO:teuthology.orchestra.run.smithi003:> uname -m 2019-11-27T14:44:11.567 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2019-11-27T14:44:11.567 INFO:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2019-11-27T14:44:11.641 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Linux" 2019-11-27T14:44:11.641 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="7 (Core)" 2019-11-27T14:44:11.641 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2019-11-27T14:44:11.641 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="7" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T14:44:11.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:44:11.643 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T14:44:11.643 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T14:44:11.643 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T14:44:11.643 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T14:44:11.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:44:11.644 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2019-11-27T14:44:11.656 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-27T14:44:11.685 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDbfcm/22npjzUNSYeInycTT0J+QiMU27HTcWyN5iaMIKJCJZKvbcRsmvn6vKthwATXwsWwzw5ivz1UEMPEUody9WiJFgrqoaglYhvNl7QgCwPz4HBoAm+4wWzfuqumOI3Ul6DpZ2AcTPyYH6SvJwXgHu77sYa77awloxCopIhHR2mgKbUEcAmKrslDUq6s0d2an6mfIYsXHYS9XwhH8bFa1JSnedq8q9Pisz4RrcviJyoTQrCGgGrDWcIgFQ3cUy2ouJYaNDPnbMiEQ3+jqcc7pUHl6UapHtbR23K7lIIXtLMGAKMm+U8WN59LGivgwoGGqAEW4QRAqUwbC8v4CLGX smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCdp8Gj3/TmzwM5CIQtjS6iSDDwF+ZabNNsx2UM/jFQFIjaOXr7/zdpgeRXsJ7zl7uzPt8N+ZfKSGFFEZoHDGXmD5Jpu4DvPFU6Qs5+lB7tJeWGaK3Rmxb2PkYGggtrHaAlMxxi3KxFPcLvw8AY/Ej6HM9yoNwI+zZZ37Qf5/YXUstnDr7LL1mUEAZR2r8tsmv6gat3JDW+kOges/RiAubLP279sVgrUesjFFK77hs9lSfcov70MsZKCi77TOTYruAG5CIN0bpvEznTqb1XIpjZ7sDpcFLYWtIfpH89cNlpmCkIOn6PQLsBFKGBETkIApimusMkv7qTKZQLCPZSGfH 2019-11-27T14:44:11.685 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-27T14:44:11.726 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-27T14:44:11.734 INFO:teuthology.task.internal:Saving configuration 2019-11-27T14:44:11.756 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-27T14:44:11.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-27T14:44:11.786 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-27 14:39:14.218599', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi156.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0soMU0mPg+t3Vz61JDk5vOIfUWoqkRRG27OqwPBU2PK/7XTmEMEng4RUM/T4j6Kk7o5v4g8xF8/0TbyrSxJI4=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447'} 2019-11-27T14:44:11.800 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-27 14:39:14.218619', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi003.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN6tH4JgITXRUSbPJoXgtPyJf2+5AamH08SImDGUMk/U13xDoVCvQ7lQz9cleS3LXjHbtgPc044hdebc/Xtq3PY=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447'} 2019-11-27T14:44:11.800 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-27T14:44:11.834 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-27T14:44:11.834 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-27T14:44:11.834 INFO:teuthology.run_tasks:Running task console_log... 2019-11-27T14:44:11.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-27T14:44:11.992 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-27T14:44:12.002 INFO:teuthology.task.internal:Opening connections... 2019-11-27T14:44:12.002 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:44:12.003 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:44:12.104 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:44:12.104 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:44:12.208 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-27T14:44:12.218 INFO:teuthology.orchestra.run.smithi156:> uname -m 2019-11-27T14:44:12.444 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2019-11-27T14:44:12.444 INFO:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2019-11-27T14:44:12.507 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Linux" 2019-11-27T14:44:12.507 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="7 (Core)" 2019-11-27T14:44:12.507 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2019-11-27T14:44:12.507 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2019-11-27T14:44:12.507 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="7" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:12.508 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T14:44:12.509 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T14:44:12.509 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T14:44:12.509 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T14:44:12.509 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:12.509 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2019-11-27T14:44:12.529 INFO:teuthology.orchestra.run.smithi003:> uname -m 2019-11-27T14:44:12.657 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2019-11-27T14:44:12.657 INFO:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Linux" 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="7 (Core)" 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="7" 2019-11-27T14:44:12.740 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.centos.org/" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-27T14:44:12.741 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-27T14:44:12.742 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-27T14:44:12.742 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-27T14:44:12.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:44:12.742 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2019-11-27T14:44:12.760 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-27T14:44:12.779 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-27T14:44:12.790 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-27T14:44:12.790 INFO:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2019-11-27T14:44:12.795 INFO:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2019-11-27T14:44:12.878 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-27T14:44:12.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-27T14:44:12.889 INFO:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2019-11-27T14:44:12.893 INFO:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2019-11-27T14:44:12.984 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-27T14:44:13.022 INFO:teuthology.run_tasks:Running task kernel... 2019-11-27T14:44:13.039 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-11-27T14:44:13.039 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-27T14:44:13.039 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:44:13.040 INFO:teuthology.orchestra.run.smithi156:> sudo package-cleanup -y --oldkernels 2019-11-27T14:44:13.907 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:44:15.654 INFO:teuthology.orchestra.run.smithi156.stdout:No old kernels to remove 2019-11-27T14:44:15.671 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:44:15.671 INFO:teuthology.orchestra.run.smithi003:> sudo package-cleanup -y --oldkernels 2019-11-27T14:44:16.563 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:44:18.296 INFO:teuthology.orchestra.run.smithi003.stdout:No old kernels to remove 2019-11-27T14:44:18.313 INFO:teuthology.orchestra.run.smithi156:> uname -r 2019-11-27T14:44:18.410 INFO:teuthology.orchestra.run.smithi156.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:44:18.410 INFO:teuthology.task.kernel:Running kernel on smithi156: 3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:44:18.410 INFO:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2019-11-27T14:44:18.631 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:44:18.687 INFO:teuthology.orchestra.run.smithi156.stdout:Determining fastest mirrors 2019-11-27T14:44:18.846 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:44:18.847 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: ftp.linux.ncsu.edu 2019-11-27T14:44:18.847 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.rackspace.com 2019-11-27T14:44:18.848 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:44:20.614 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:44:20.614 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:44:20.614 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-27T14:44:22.192 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:44:23.272 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:23.272 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:44:23.278 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:23.278 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:44:23.278 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:44:23.278 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:44:23.278 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 50 M 2019-11-27T14:44:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 64 M 2019-11-27T14:44:23.280 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:44:23.281 INFO:teuthology.orchestra.run.smithi156.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T14:44:24.549 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:44:24.738 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:44:25.672 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:44:25.673 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:45:00.386 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T14:45:00.899 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T14:45:00.899 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:45:00.900 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:45:00.900 INFO:teuthology.orchestra.run.smithi156.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-27T14:45:00.900 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:45:00.900 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:45:00.949 INFO:teuthology.orchestra.run.smithi156:> rpm -q kernel --last | head -n 1 2019-11-27T14:45:01.334 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 02:44:28 PM UTC 2019-11-27T14:45:01.336 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:01.336 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:01.336 INFO:teuthology.orchestra.run.smithi003:> uname -r 2019-11-27T14:45:01.436 INFO:teuthology.orchestra.run.smithi003.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:45:01.436 INFO:teuthology.task.kernel:Running kernel on smithi003: 3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:45:01.437 INFO:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2019-11-27T14:45:01.711 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:45:01.754 INFO:teuthology.orchestra.run.smithi003.stdout:Determining fastest mirrors 2019-11-27T14:45:01.913 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.es.its.nyu.edu 2019-11-27T14:45:01.914 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: ftp.linux.ncsu.edu 2019-11-27T14:45:01.914 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.jaleco.com 2019-11-27T14:45:01.915 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:45:04.081 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:45:04.082 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:45:04.082 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-27T14:45:05.377 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:45:06.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:06.172 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:45:06.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:06.173 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:45:06.173 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:45:06.173 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2019-11-27T14:45:06.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:06.175 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 50 M 2019-11-27T14:45:06.175 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 64 M 2019-11-27T14:45:06.175 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:45:06.176 INFO:teuthology.orchestra.run.smithi003.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T14:45:07.306 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:45:07.503 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:45:08.427 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:45:08.427 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:45:45.729 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T14:45:46.270 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-27T14:45:46.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:46.271 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:45:46.271 INFO:teuthology.orchestra.run.smithi003.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-27T14:45:46.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:46.271 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:45:46.323 INFO:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2019-11-27T14:45:46.726 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 02:45:11 PM UTC 2019-11-27T14:45:46.730 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:46.730 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:46.730 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-27T14:45:46.730 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-27T14:45:46.730 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-27T14:45:46.731 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-27T14:45:46.731 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2019-11-27T14:45:46.731 INFO:teuthology.orchestra.run.smithi156:> rpm -q kernel --last | head -n 1 2019-11-27T14:45:47.101 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 02:44:28 PM UTC 2019-11-27T14:45:47.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:47.104 INFO:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2 2019-11-27T14:45:47.229 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.02 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 0.76.el7.centos 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-27T14:45:47.230 INFO:teuthology.orchestra.run.smithi156.stdout:Group : System Environment/Base 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 0 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-27T14:45:47.231 INFO:teuthology.orchestra.run.smithi156.stdout:Relocations : (not relocatable) 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : CentOS BuildSystem 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:45:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-27T14:45:47.233 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-27T14:45:47.233 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-27T14:45:47.233 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2019-11-27T14:45:47.234 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-27T14:45:47.234 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:47.234 INFO:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-27T14:45:47.783 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2019-11-27T14:45:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:47.935 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-27T14:45:48.164 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:45:48.181 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-27T14:45:48.212 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-27T14:45:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-27T14:45:48.257 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-27T14:45:48.266 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-27T14:45:49.373 INFO:teuthology.orchestra.run.smithi156.stderr:done 2019-11-27T14:45:49.375 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:45:49.428 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.lNhCnXdpnq 2019-11-27T14:45:49.442 INFO:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lNhCnXdpnq 2019-11-27T14:45:49.526 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.lNhCnXdpnq 2019-11-27T14:45:49.672 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.lNhCnXdpnq is 6KB 2019-11-27T14:45:49.727 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.lNhCnXdpnq 2019-11-27T14:45:49.781 INFO:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 0 2019-11-27T14:45:49.936 INFO:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2019-11-27T14:45:49.940 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-27T14:45:49.941 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2019-11-27T14:45:49.941 INFO:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2019-11-27T14:45:50.300 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Wed 27 Nov 2019 02:45:11 PM UTC 2019-11-27T14:45:50.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:50.303 INFO:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2 2019-11-27T14:45:50.426 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2 2019-11-27T14:45:50.426 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2019-11-27T14:45:50.426 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.02 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 0.76.el7.centos 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:Group : System Environment/Base 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 0 2019-11-27T14:45:50.427 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Relocations : (not relocatable) 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : CentOS BuildSystem 2019-11-27T14:45:50.428 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-27T14:45:50.429 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-27T14:45:50.430 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2019-11-27T14:45:50.430 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-27T14:45:50.431 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:50.431 INFO:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-27T14:45:50.894 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2019-11-27T14:45:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:45:51.075 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-27T14:45:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-27T14:45:51.407 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-27T14:45:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-27T14:45:51.475 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-27T14:45:51.509 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-27T14:45:51.521 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-27T14:45:52.733 INFO:teuthology.orchestra.run.smithi003.stderr:done 2019-11-27T14:45:52.736 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:45:52.798 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.JRCEsYOFAj 2019-11-27T14:45:52.799 INFO:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JRCEsYOFAj 2019-11-27T14:45:52.894 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.JRCEsYOFAj 2019-11-27T14:45:53.065 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.JRCEsYOFAj is 6KB 2019-11-27T14:45:53.143 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.JRCEsYOFAj 2019-11-27T14:45:53.220 INFO:teuthology.orchestra.run.smithi003:> sudo grub2-set-default 0 2019-11-27T14:45:53.410 INFO:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2019-11-27T14:45:53.415 INFO:teuthology.misc:Re-opening connections... 2019-11-27T14:45:53.415 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:45:53.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:45:53.415 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:46:53.417 DEBUG:teuthology.orchestra.remote:timed out 2019-11-27T14:46:53.417 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:46:53.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:46:53.418 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:11.800 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2019-11-27T14:47:11.801 DEBUG:teuthology.misc:waited 78.3858308792 2019-11-27T14:47:12.802 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:47:12.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:47:12.802 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:31.260 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2019-11-27T14:47:31.261 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:47:31.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:47:31.261 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:31.346 INFO:teuthology.orchestra.run.smithi003:> true 2019-11-27T14:47:31.636 DEBUG:teuthology.misc:waited 98.2215428352 2019-11-27T14:47:32.637 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:47:32.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:47:32.638 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:35.188 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2019-11-27T14:47:35.189 DEBUG:teuthology.misc:waited 101.773910999 2019-11-27T14:47:36.190 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:47:36.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:47:36.190 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:36.191 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2019-11-27T14:47:36.191 DEBUG:teuthology.misc:waited 102.776680946 2019-11-27T14:47:37.192 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:47:37.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:47:37.193 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:47:37.277 INFO:teuthology.orchestra.run.smithi156:> true 2019-11-27T14:47:37.556 DEBUG:teuthology.misc:waited 104.141145945 2019-11-27T14:47:38.557 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-27T14:47:38.557 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-27T14:47:38.557 INFO:teuthology.orchestra.run.smithi156:> uname -r 2019-11-27T14:47:38.644 INFO:teuthology.orchestra.run.smithi156.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:47:38.645 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:47:38.645 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-27T14:47:38.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-27T14:47:38.645 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-27T14:47:38.645 INFO:teuthology.orchestra.run.smithi003:> uname -r 2019-11-27T14:47:38.741 INFO:teuthology.orchestra.run.smithi003.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:47:38.741 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-27T14:47:38.741 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-27T14:47:39.742 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-27T14:47:39.742 INFO:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-27T14:47:39.850 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2019-11-27T14:47:39.863 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-27T14:47:39.863 INFO:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-27T14:47:40.021 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2019-11-27T14:47:40.034 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-27T14:47:40.043 INFO:teuthology.task.internal:Creating test directory... 2019-11-27T14:47:40.043 INFO:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-27T14:47:40.048 INFO:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-27T14:47:40.131 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-27T14:47:40.141 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-27T14:47:40.152 INFO:teuthology.task.internal:Creating archive directory... 2019-11-27T14:47:40.152 INFO:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-27T14:47:40.157 INFO:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-27T14:47:40.255 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-27T14:47:40.264 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-27T14:47:40.264 INFO:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T14:47:40.269 INFO:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T14:47:40.330 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T14:47:40.371 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-27T14:47:40.374 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-27T14:47:40.383 INFO:teuthology.task.internal:Configuring sudo... 2019-11-27T14:47:40.383 INFO:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-27T14:47:40.387 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-27T14:47:40.487 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-27T14:47:40.499 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-27T14:47:40.499 INFO:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-27T14:47:40.504 INFO:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-27T14:47:40.571 INFO:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T14:47:40.630 INFO:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T14:47:40.697 INFO:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T14:47:40.759 INFO:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T14:47:40.815 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-27T14:47:40.873 INFO:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T14:47:40.981 INFO:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-27T14:47:41.106 INFO:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T14:47:41.204 INFO:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-27T14:47:41.315 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-27T14:47:41.407 INFO:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2019-11-27T14:47:41.411 INFO:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2019-11-27T14:47:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-27T14:47:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-27T14:47:41.549 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-27T14:47:41.558 INFO:teuthology.task.internal:Starting timer... 2019-11-27T14:47:41.558 INFO:teuthology.run_tasks:Running task pcp... 2019-11-27T14:47:41.591 INFO:teuthology.run_tasks:Running task selinux... 2019-11-27T14:47:41.602 INFO:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2019-11-27T14:47:41.753 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: [ OK ] 2019-11-27T14:47:41.755 INFO:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2019-11-27T14:47:41.847 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: [ OK ] 2019-11-27T14:47:41.849 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-27T14:47:41.849 INFO:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2019-11-27T14:47:41.901 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2019-11-27T14:47:41.901 INFO:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2019-11-27T14:47:41.995 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2019-11-27T14:47:41.996 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi003.front.sepia.ceph.com': 'permissive'} 2019-11-27T14:47:41.996 INFO:teuthology.orchestra.run.smithi156:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-27T14:47:42.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T14:47:42.050 INFO:teuthology.orchestra.run.smithi003:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-27T14:47:42.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T14:47:42.169 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-27T14:47:42.169 INFO:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2019-11-27T14:47:42.231 INFO:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2019-11-27T14:47:42.360 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-27T14:47:42.370 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-11-27T14:47:42.395 INFO:teuthology.repo_utils:Fetching master from origin 2019-11-27T14:47:42.497 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-27T14:47:42.532 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-27T14:47:42.535 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi156.front.sepia.ceph.com,smithi003.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-27T14:47:42.927 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-27T14:47:46.609 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-27T14:47:46.631 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:46 +0000 (0:00:00.066) 0:00:00.066 **** 2019-11-27T14:47:46.643 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:46 +0000 (0:00:00.012) 0:00:00.079 **** 2019-11-27T14:47:49.351 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi156.front.sepia.ceph.com] 2019-11-27T14:47:49.424 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:49 +0000 (0:00:02.780) 0:00:02.859 **** 2019-11-27T14:47:49.757 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-27T14:47:49.759 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T14:47:49.797 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:49 +0000 (0:00:00.373) 0:00:03.233 **** 2019-11-27T14:47:49.806 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-11-27T14:47:49.808 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] 2019-11-27T14:47:49.881 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:49 +0000 (0:00:00.083) 0:00:03.316 **** 2019-11-27T14:47:50.206 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-27T14:47:50.207 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T14:47:50.242 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.360) 0:00:03.677 **** 2019-11-27T14:47:50.247 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-27T14:47:50.248 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-27T14:47:50.285 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.042) 0:00:03.720 **** 2019-11-27T14:47:50.310 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-27T14:47:50.311 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:50.346 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.060) 0:00:03.781 **** 2019-11-27T14:47:50.640 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-27T14:47:50.641 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-27T14:47:50.678 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.332) 0:00:04.114 **** 2019-11-27T14:47:50.703 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-27T14:47:50.704 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:50.738 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.059) 0:00:04.173 **** 2019-11-27T14:47:50.762 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-27T14:47:50.763 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:47:50.800 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:50 +0000 (0:00:00.062) 0:00:04.236 **** 2019-11-27T14:47:51.065 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:47:51.101 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:51 +0000 (0:00:00.300) 0:00:04.536 **** 2019-11-27T14:47:52.282 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-27T14:47:52.282 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866070.82-218298069676237/source", "state": "file", "uid": 0} 2019-11-27T14:47:52.319 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:52 +0000 (0:00:01.218) 0:00:05.755 **** 2019-11-27T14:47:52.324 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866071.12-259646676976106/source", "state": "file", "uid": 0} 2019-11-27T14:47:52.361 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:52 +0000 (0:00:00.041) 0:00:05.797 **** 2019-11-27T14:47:52.862 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-27T14:47:52.862 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:52.884 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.163 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.185 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.498 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.530 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.832 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:53.833 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.113 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.145 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.414 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.456 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.706 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.749 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-27T14:47:54.862 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-27T14:47:54.868 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-27T14:47:55.039 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:55 +0000 (0:00:02.677) 0:00:08.474 **** 2019-11-27T14:47:55.071 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:55 +0000 (0:00:00.031) 0:00:08.506 **** 2019-11-27T14:47:55.994 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2019-11-27T14:47:56.037 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] 2019-11-27T14:47:56.080 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-11-27T14:47:56.081 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:56 +0000 (0:00:01.009) 0:00:09.515 **** 2019-11-27T14:47:56.146 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:56 +0000 (0:00:00.066) 0:00:09.581 **** 2019-11-27T14:47:56.584 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-11-27T14:47:56.585 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.236182", "end": "2019-11-27 14:47:56.557538", "rc": 0, "start": "2019-11-27 14:47:56.321356", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-27T14:47:56.621 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:56 +0000 (0:00:00.474) 0:00:10.056 **** 2019-11-27T14:47:56.626 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.242884", "end": "2019-11-27 14:47:56.567178", "rc": 0, "start": "2019-11-27 14:47:56.324294", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-27T14:47:56.662 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:56 +0000 (0:00:00.041) 0:00:10.098 **** 2019-11-27T14:47:56.955 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-27T14:47:56.957 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015397", "end": "2019-11-27 14:47:56.931296", "failed_when_result": false, "rc": 0, "start": "2019-11-27 14:47:56.915899", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-27T14:47:56.993 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:56 +0000 (0:00:00.330) 0:00:10.428 **** 2019-11-27T14:47:56.999 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017397", "end": "2019-11-27 14:47:56.939019", "failed_when_result": false, "rc": 0, "start": "2019-11-27 14:47:56.921622", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-27T14:47:57.036 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.042) 0:00:10.471 **** 2019-11-27T14:47:57.040 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-27T14:47:57.042 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.078 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.041) 0:00:10.513 **** 2019-11-27T14:47:57.085 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.120 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.042) 0:00:10.556 **** 2019-11-27T14:47:57.125 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-27T14:47:57.126 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.161 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.040) 0:00:10.596 **** 2019-11-27T14:47:57.165 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.203 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.042) 0:00:10.639 **** 2019-11-27T14:47:57.208 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-27T14:47:57.209 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.243 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.040) 0:00:10.679 **** 2019-11-27T14:47:57.247 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.283 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.039) 0:00:10.718 **** 2019-11-27T14:47:57.289 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-11-27T14:47:57.290 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.324 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.040) 0:00:10.759 **** 2019-11-27T14:47:57.328 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.366 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.042) 0:00:10.802 **** 2019-11-27T14:47:57.371 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-27T14:47:57.372 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.409 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.042) 0:00:10.844 **** 2019-11-27T14:47:57.413 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:47:57.450 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.040) 0:00:10.885 **** 2019-11-27T14:47:57.737 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-27T14:47:57.739 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:47:57.775 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.325) 0:00:11.211 **** 2019-11-27T14:47:57.781 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:47:57.819 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:47:57 +0000 (0:00:00.043) 0:00:11.254 **** 2019-11-27T14:47:58.145 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T14:47:58.146 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-27T14:47:58.220 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-27T14:47:58.448 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-27T14:47:58.563 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-27T14:47:58.791 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-27T14:47:58.896 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-27T14:47:59.063 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-27T14:47:59.209 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-27T14:47:59.324 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-27T14:47:59.531 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-27T14:47:59.595 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-27T14:47:59.876 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-27T14:47:59.877 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-27T14:48:00.210 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-27T14:48:00.232 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-27T14:48:00.522 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-27T14:48:00.554 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-27T14:48:00.844 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-27T14:48:00.886 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-27T14:48:01.146 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-27T14:48:01.219 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-27T14:48:01.466 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-27T14:48:01.539 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-27T14:48:01.786 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-27T14:48:01.831 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-27T14:48:02.078 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-27T14:48:02.162 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-27T14:48:02.379 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-27T14:48:02.473 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-27T14:48:02.711 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-27T14:48:02.794 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-27T14:48:03.064 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-27T14:48:03.117 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-27T14:48:03.370 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-27T14:48:03.404 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-27T14:48:03.697 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-27T14:48:03.698 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-27T14:48:04.030 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-27T14:48:04.041 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-27T14:48:04.364 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-27T14:48:04.365 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-27T14:48:04.679 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-27T14:48:04.691 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-27T14:48:04.994 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-27T14:48:05.016 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-27T14:48:05.327 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-27T14:48:10.218 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"n 2019-11-27T14:48:10.219 INFO:teuthology.task.ansible.out:ame": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {" 2019-11-27T14:48:10.221 INFO:teuthology.task.ansible.out:name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yeh 2019-11-27T14:48:10.222 INFO:teuthology.task.ansible.out:uda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f 2019-11-27T14:48:10.224 INFO:teuthology.task.ansible.out:92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item" 2019-11-27T14:48:10.225 INFO:teuthology.task.ansible.out:: {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtgg 2019-11-27T14:48:10.226 INFO:teuthology.task.ansible.out:rwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1 2019-11-27T14:48:10.228 INFO:teuthology.task.ansible.out:132} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b 2019-11-27T14:48:10.229 INFO:teuthology.task.ansible.out:4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-27T14:48:10.230 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-27T14:48:10.232 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-27T14:48:10.233 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-27T14:48:10.234 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-27T14:48:10.236 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-27T14:48:10.237 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-27T14:48:10.238 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-27T14:48:10.240 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-27T14:48:10.354 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-27T14:48:10.489 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-27T14:48:10.717 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-27T14:48:10.801 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-27T14:48:11.040 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-27T14:48:11.134 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T14:48:11.392 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-27T14:48:11.476 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-27T14:48:11.703 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T14:48:11.786 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-27T14:48:12.034 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-27T14:48:12.108 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-27T14:48:12.376 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-27T14:48:12.439 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-27T14:48:12.730 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-27T14:48:12.762 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-27T14:48:13.030 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-27T14:48:13.073 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-27T14:48:13.382 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-27T14:48:13.414 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-27T14:48:13.724 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-27T14:48:13.746 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-27T14:48:14.036 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-27T14:48:14.088 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-27T14:48:14.347 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-27T14:48:14.441 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-27T14:48:14.680 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-27T14:48:14.784 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-27T14:48:14.950 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-27T14:48:15.096 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-27T14:48:15.253 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T14:48:15.453 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-27T14:48:15.589 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-27T14:48:15.776 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-27T14:48:15.932 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-27T14:48:16.119 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T14:48:16.255 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-27T14:48:16.473 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-27T14:48:16.587 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-27T14:48:16.805 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-27T14:48:16.920 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-27T14:48:17.148 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-27T14:48:17.233 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-27T14:48:17.482 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-27T14:48:17.545 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-27T14:48:17.826 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-27T14:48:18.162 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-27T14:48:18.486 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-27T14:48:18.508 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-27T14:48:18.809 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-27T14:48:18.852 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-27T14:48:19.103 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-27T14:48:19.196 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-27T14:48:19.437 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-27T14:48:19.542 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-27T14:48:19.774 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-27T14:48:19.889 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-27T14:48:20.099 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-27T14:48:20.224 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-27T14:48:20.401 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-27T14:48:20.569 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-27T14:48:20.768 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-27T14:48:20.915 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-27T14:48:21.064 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-27T14:48:21.255 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-27T14:48:21.390 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-27T14:48:21.609 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-27T14:48:21.764 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-27T14:48:21.951 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-27T14:48:22.121 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T14:48:22.299 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-27T14:48:22.426 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-27T14:48:22.645 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-27T14:48:22.741 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-27T14:48:22.951 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-27T14:48:23.068 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-27T14:48:23.288 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-27T14:48:23.403 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-27T14:48:23.607 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-27T14:48:23.712 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-27T14:48:23.962 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-27T14:48:24.026 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-27T14:48:24.307 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-27T14:48:24.367 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-27T14:48:24.640 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-27T14:48:24.682 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-27T14:48:24.994 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-27T14:48:25.028 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-27T14:48:25.339 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-27T14:48:25.351 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-27T14:48:25.683 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-27T14:48:25.705 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-27T14:48:26.027 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-27T14:48:26.048 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-27T14:48:26.381 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-27T14:48:26.403 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-27T14:48:26.724 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-27T14:48:26.726 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-27T14:48:27.057 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-27T14:48:27.079 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-27T14:48:27.401 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-27T14:48:27.434 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-27T14:48:27.713 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-27T14:48:27.776 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-27T14:48:28.067 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-27T14:48:28.101 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-27T14:48:28.404 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-27T14:48:28.415 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-27T14:48:28.726 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-27T14:48:28.738 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-27T14:48:29.060 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-27T14:48:29.072 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-27T14:48:29.394 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-27T14:48:29.406 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-27T14:48:29.728 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-27T14:48:29.750 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-27T14:48:30.051 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-27T14:48:30.063 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-27T14:48:30.367 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-27T14:48:30.390 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-27T14:48:30.695 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-27T14:48:30.717 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-27T14:48:31.038 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-27T14:48:31.039 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-27T14:48:31.384 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-27T14:48:31.385 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-27T14:48:31.717 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-27T14:48:31.729 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-27T14:48:32.052 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-27T14:48:32.063 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-27T14:48:32.395 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-27T14:48:32.396 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-27T14:48:32.694 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-27T14:48:32.736 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-27T14:48:33.036 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-27T14:48:33.068 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-27T14:48:33.389 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-27T14:48:33.390 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-27T14:48:33.680 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-27T14:48:33.733 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-27T14:48:34.013 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-27T14:48:34.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-27T14:48:34.319 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-27T14:48:34.415 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-27T14:48:34.678 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-27T14:48:34.741 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-27T14:48:35.023 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-27T14:48:35.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-27T14:48:35.366 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T14:48:35.398 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-27T14:48:35.689 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-27T14:48:35.711 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-27T14:48:36.023 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-27T14:48:36.344 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-27T14:48:36.362 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-27T14:48:36.616 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:36 +0000 (0:00:38.797) 0:00:50.051 **** 2019-11-27T14:48:36.642 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-27T14:48:36.680 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:36 +0000 (0:00:00.064) 0:00:50.116 **** 2019-11-27T14:48:36.686 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T14:48:36.687 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-27T14:48:36.733 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-27T14:48:36.742 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-27T14:48:36.744 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-27T14:48:36.745 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-27T14:48:36.746 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-27T14:48:36.748 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851 2019-11-27T14:48:36.749 INFO:teuthology.task.ansible.out:f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde189 2019-11-27T14:48:36.751 INFO:teuthology.task.ansible.out:0af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f45903 2019-11-27T14:48:36.752 INFO:teuthology.task.ansible.out:0cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d7 2019-11-27T14:48:36.753 INFO:teuthology.task.ansible.out:12ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA d 2019-11-27T14:48:36.755 INFO:teuthology.task.ansible.out:a2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@ 2019-11-27T14:48:36.756 INFO:teuthology.task.ansible.out:localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.re 2019-11-27T14:48:36.758 INFO:teuthology.task.ansible.out:dhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-27T14:48:36.797 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:36 +0000 (0:00:00.115) 0:00:50.232 **** 2019-11-27T14:48:37.030 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-27T14:48:37.030 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-27T14:48:37.709 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-27T14:48:37.928 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-27T14:48:37.929 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-27T14:48:37.963 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:37 +0000 (0:00:01.166) 0:00:51.398 **** 2019-11-27T14:48:37.998 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:37 +0000 (0:00:00.034) 0:00:51.433 **** 2019-11-27T14:48:38.003 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-27T14:48:38.046 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:38 +0000 (0:00:00.048) 0:00:51.482 **** 2019-11-27T14:48:38.096 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-27T14:48:38.101 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-27T14:48:38.103 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-27T14:48:38.104 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-27T14:48:38.106 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-27T14:48:38.107 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-27T14:48:38.108 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-27T14:48:38.110 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0 2019-11-27T14:48:38.111 INFO:teuthology.task.ansible.out:bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "l 2019-11-27T14:48:38.113 INFO:teuthology.task.ansible.out:iupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc5 2019-11-27T14:48:38.116 INFO:teuthology.task.ansible.out:57b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe578 2019-11-27T14:48:38.117 INFO:teuthology.task.ansible.out:14d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88 2019-11-27T14:48:38.118 INFO:teuthology.task.ansible.out:f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovp 2019-11-27T14:48:38.120 INFO:teuthology.task.ansible.out:n": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-27T14:48:38.156 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:38 +0000 (0:00:00.109) 0:00:51.591 **** 2019-11-27T14:48:38.404 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:48:38.404 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-27T14:48:38.727 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-27T14:48:38.790 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-27T14:48:38.792 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-27T14:48:38.838 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:48:38 +0000 (0:00:00.681) 0:00:52.273 **** 2019-11-27T14:48:39.073 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:48:39.073 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-27T14:48:39.245 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-27T14:48:39.433 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-27T14:48:39.589 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-27T14:48:39.786 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-27T14:48:39.788 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-27T14:48:39.953 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-27T14:48:40.118 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-27T14:48:40.295 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-27T14:48:40.477 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-27T14:48:40.479 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-27T14:48:40.644 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-27T14:48:40.645 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-27T14:48:40.826 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-27T14:48:41.003 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-27T14:48:41.166 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-27T14:48:41.167 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:41.354 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-27T14:48:41.355 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-27T14:48:41.490 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-27T14:48:41.492 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-27T14:48:41.501 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:41.512 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:41.523 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:41.536 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:41.713 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-27T14:48:41.848 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-27T14:48:42.046 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-27T14:48:42.056 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:42.213 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-27T14:48:42.215 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-27T14:48:42.401 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-27T14:48:42.403 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-27T14:48:42.414 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:42.414 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:42.425 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:42.436 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:48:42.564 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-27T14:48:42.802 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-27T14:48:42.917 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-27T14:48:43.146 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-27T14:48:43.147 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-27T14:48:43.282 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-27T14:48:43.511 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-27T14:48:43.626 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-27T14:48:43.861 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-27T14:48:43.986 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-27T14:48:44.205 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-27T14:48:44.361 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-27T14:48:44.538 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-27T14:48:44.725 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-27T14:48:44.727 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-27T14:48:44.887 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-27T14:48:45.074 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-27T14:48:45.076 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-27T14:48:45.230 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-27T14:48:45.429 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-27T14:48:45.544 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-27T14:48:45.545 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-27T14:48:45.762 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-27T14:48:45.907 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-27T14:48:45.909 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-27T14:48:46.131 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-27T14:48:46.132 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-27T14:48:46.255 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-27T14:48:46.462 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-27T14:48:46.607 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-27T14:48:46.794 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-27T14:48:46.940 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-27T14:48:46.941 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-27T14:48:47.113 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-27T14:48:47.300 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-27T14:48:47.438 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-27T14:48:47.635 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-27T14:48:47.762 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-27T14:48:47.970 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-27T14:48:48.119 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-27T14:48:48.121 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-27T14:48:48.306 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-27T14:48:48.445 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-27T14:48:48.446 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-27T14:48:48.652 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-27T14:48:48.770 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-27T14:48:49.009 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-27T14:48:49.011 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-27T14:48:49.114 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-27T14:48:49.353 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-27T14:48:49.355 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-27T14:48:49.481 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-27T14:48:49.689 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-27T14:48:49.824 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-27T14:48:50.031 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-27T14:48:50.157 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-27T14:48:50.366 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-27T14:48:50.506 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-27T14:48:50.734 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-27T14:48:50.859 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T14:48:51.067 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-27T14:48:51.194 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-27T14:48:51.422 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-27T14:48:51.538 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-27T14:48:51.776 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T14:48:51.900 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-27T14:48:52.118 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-27T14:48:52.273 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-27T14:48:52.275 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-27T14:48:52.461 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-27T14:48:52.653 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQSh 2019-11-27T14:48:52.654 INFO:teuthology.task.ansible.out:GhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-27T14:48:52.822 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-27T14:48:53.000 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-27T14:48:53.159 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-27T14:48:53.161 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-27T14:48:53.336 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-27T14:48:53.511 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-27T14:48:53.512 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-27T14:48:53.678 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-27T14:48:53.857 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-27T14:48:53.982 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-27T14:48:54.192 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-27T14:48:54.318 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-27T14:48:54.527 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-27T14:48:54.652 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-27T14:48:54.881 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-27T14:48:54.976 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-27T14:48:55.183 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-27T14:48:55.312 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-27T14:48:55.313 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T14:48:55.530 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-27T14:48:55.656 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-27T14:48:55.658 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-27T14:48:55.659 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-27T14:48:55.874 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-27T14:48:55.989 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-27T14:48:56.237 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-27T14:48:56.239 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T14:48:56.321 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-27T14:48:56.592 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-27T14:48:56.594 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-27T14:48:56.595 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-27T14:48:56.645 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-27T14:48:56.935 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-27T14:48:56.967 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-27T14:48:56.968 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-27T14:48:57.268 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-27T14:48:57.300 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-27T14:48:57.603 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-27T14:48:57.635 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-27T14:48:57.963 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-27T14:48:57.964 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-27T14:48:57.965 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-27T14:48:58.283 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-27T14:48:58.305 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-27T14:48:58.638 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-27T14:48:58.649 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-27T14:48:58.934 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-27T14:48:59.014 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-27T14:48:59.254 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-27T14:48:59.256 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-27T14:48:59.349 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-27T14:48:59.612 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-27T14:48:59.675 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-27T14:48:59.675 INFO:teuthology.task.ansible.out: 2019-11-27T14:48:59.915 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-27T14:49:00.009 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-27T14:49:00.250 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-27T14:49:00.251 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-27T14:49:00.344 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-27T14:49:00.346 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-27T14:49:00.572 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-27T14:49:00.698 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-27T14:49:00.895 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-27T14:49:01.030 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-27T14:49:01.221 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-27T14:49:01.397 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-27T14:49:01.398 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-27T14:49:01.538 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-27T14:49:01.725 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-27T14:49:01.891 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-27T14:49:02.098 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-27T14:49:02.223 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T14:49:02.454 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-27T14:49:02.578 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-27T14:49:02.815 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-27T14:49:02.909 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-27T14:49:03.163 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-27T14:49:03.257 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-27T14:49:03.478 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-27T14:49:03.603 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-27T14:49:03.830 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-27T14:49:03.935 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-27T14:49:04.212 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-27T14:49:04.261 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-27T14:49:04.561 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-27T14:49:04.614 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-27T14:49:04.903 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-27T14:49:04.956 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-27T14:49:05.247 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-27T14:49:05.290 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-27T14:49:05.570 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-27T14:49:05.622 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-27T14:49:05.922 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-27T14:49:05.955 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-27T14:49:06.268 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-27T14:49:06.322 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-27T14:49:06.605 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-27T14:49:06.680 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-27T14:49:06.950 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-27T14:49:07.023 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-27T14:49:07.283 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-27T14:49:07.357 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-27T14:49:07.641 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-27T14:49:07.684 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-27T14:49:08.006 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-27T14:49:08.018 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-27T14:49:08.359 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-27T14:49:08.371 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-27T14:49:08.687 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-27T14:49:08.719 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-27T14:49:09.010 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-27T14:49:09.085 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-27T14:49:09.358 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-27T14:49:09.452 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-27T14:49:09.702 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-27T14:49:09.796 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-27T14:49:10.035 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-27T14:49:10.129 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-27T14:49:10.388 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-27T14:49:10.390 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-27T14:49:10.482 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-27T14:49:10.702 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-27T14:49:10.704 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-27T14:49:10.848 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-27T14:49:11.035 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-27T14:49:11.192 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-27T14:49:11.359 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-27T14:49:11.531 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-27T14:49:11.687 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-27T14:49:11.905 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-27T14:49:11.906 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-27T14:49:12.030 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-27T14:49:12.259 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-27T14:49:12.260 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-27T14:49:12.396 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-27T14:49:12.596 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-27T14:49:12.731 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-27T14:49:12.933 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-27T14:49:13.081 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-27T14:49:13.289 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-27T14:49:13.434 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-27T14:49:13.641 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-27T14:49:13.765 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-27T14:49:13.993 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-27T14:49:14.113 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-27T14:49:14.341 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-27T14:49:14.467 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-27T14:49:14.697 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-27T14:49:14.760 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-27T14:49:15.004 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-27T14:49:15.082 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-27T14:49:15.342 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-27T14:49:15.449 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-27T14:49:15.692 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-27T14:49:15.778 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-27T14:49:15.780 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T14:49:16.014 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-27T14:49:16.099 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-27T14:49:16.358 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-27T14:49:16.443 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-27T14:49:16.671 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:16 +0000 (0:00:37.832) 0:01:30.106 **** 2019-11-27T14:49:16.718 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:16.720 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-27T14:49:16.731 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:16.732 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.743 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.754 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.769 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.781 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.792 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:16.803 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:17.055 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:49:17.056 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-27T14:49:17.171 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:17.172 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-27T14:49:17.183 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:17.373 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:49:17.375 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-27T14:49:17.376 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-27T14:49:17.521 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:17.523 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-27T14:49:17.731 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:49:17.732 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-27T14:49:17.877 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:17.879 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-27T14:49:18.072 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-27T14:49:18.074 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-27T14:49:18.158 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:18 +0000 (0:00:01.487) 0:01:31.594 **** 2019-11-27T14:49:18.205 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:18.207 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.218 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-27T14:49:18.218 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.229 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.230 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.241 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.262 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.263 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.265 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.555 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-27T14:49:18.566 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.577 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.588 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.599 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.610 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.611 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-27T14:49:18.612 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.622 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.636 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\ 2019-11-27T14:49:18.638 INFO:teuthology.task.ansible.out:n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.646 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.657 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.668 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.668 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.679 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.690 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.701 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.702 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.713 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.724 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.735 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.735 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.746 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.761 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.768 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.789 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.790 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.801 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.802 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.813 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.824 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.836 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.836 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.847 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.858 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.858 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.869 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.880 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.881 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.892 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.903 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.923 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.924 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.936 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.937 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.947 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.958 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.959 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.981 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.981 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.983 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:18.993 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.009 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-27T14:49:19.010 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.012 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.022 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.033 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.034 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.055 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.066 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.077 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.089 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.090 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.102 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.114 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.115 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.126 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.137 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.148 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.159 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.159 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.170 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.181 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.192 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.193 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.203 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.215 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.216 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.226 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.238 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.249 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.250 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.261 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.272 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.283 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.283 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.295 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.306 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.317 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.318 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.329 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.339 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.350 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.351 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.363 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-27T14:49:19.364 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.365 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.376 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.387 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.398 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.398 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.409 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.420 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.431 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.432 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.445 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.501 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:19 +0000 (0:00:01.342) 0:01:32.936 **** 2019-11-27T14:49:19.527 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-27T14:49:19.528 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:19.566 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:19 +0000 (0:00:00.065) 0:01:33.001 **** 2019-11-27T14:49:19.716 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:19.718 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-27T14:49:19.936 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:19.937 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-27T14:49:20.062 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:20.063 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-27T14:49:20.074 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.085 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.086 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.099 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.120 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.131 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.144 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.145 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.156 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.167 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.178 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.179 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.189 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.200 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.211 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.222 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.223 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.234 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.245 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.256 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.257 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.268 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:20.269 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.280 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.297 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.298 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.311 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.312 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.323 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.334 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.345 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.346 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.357 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.368 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.379 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.381 INFO:teuthology.task.ansible.out: skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.391 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.402 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.413 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.429 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.440 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.441 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.456 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.467 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.467 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.478 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.489 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.501 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.501 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.512 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.525 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.536 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.536 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.547 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.558 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.559 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.570 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:20.571 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-27T14:49:20.572 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.582 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.593 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.594 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.605 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.616 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.631 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.633 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.644 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.656 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.667 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.678 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.797 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.808 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.820 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.820 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.832 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.844 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.855 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.855 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.866 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.878 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:20.880 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-27T14:49:20.891 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-27T14:49:20.893 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.904 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.905 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.916 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.927 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.938 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.939 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.950 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.971 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.982 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.982 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.993 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:20.994 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.016 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.016 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.027 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.038 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.050 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.051 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.061 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.072 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.083 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.099 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.100 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:21.168 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:21 +0000 (0:00:01.601) 0:01:34.603 **** 2019-11-27T14:49:21.195 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-27T14:49:21.196 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi156.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-27T14:49:21.234 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:21 +0000 (0:00:00.066) 0:01:34.669 **** 2019-11-27T14:49:21.530 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-27T14:49:21.614 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-27T14:49:21.851 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-27T14:49:21.955 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-27T14:49:22.142 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-27T14:49:22.290 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-27T14:49:22.446 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-27T14:49:22.633 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-27T14:49:22.788 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-27T14:49:22.967 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-27T14:49:23.083 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-27T14:49:23.299 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-27T14:49:23.413 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-27T14:49:23.630 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-27T14:49:23.735 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-27T14:49:23.952 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-27T14:49:24.046 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-27T14:49:24.284 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-27T14:49:24.389 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-27T14:49:24.617 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-27T14:49:24.691 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-27T14:49:24.941 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-27T14:49:24.974 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-27T14:49:25.265 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-27T14:49:25.280 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-27T14:49:25.597 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-27T14:49:25.609 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-27T14:49:25.928 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-27T14:49:25.950 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-27T14:49:26.252 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-27T14:49:26.284 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-27T14:49:26.597 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-27T14:49:26.619 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-27T14:49:26.945 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-27T14:49:26.946 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-27T14:49:27.250 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-27T14:49:27.272 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-27T14:49:27.594 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-27T14:49:27.616 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-27T14:49:27.941 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-27T14:49:27.942 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-27T14:49:28.264 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-27T14:49:28.265 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-27T14:49:28.558 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-27T14:49:28.584 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-27T14:49:28.620 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:28 +0000 (0:00:07.386) 0:01:42.055 **** 2019-11-27T14:49:28.925 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-27T14:49:29.250 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-27T14:49:29.567 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-27T14:49:29.723 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-27T14:49:29.725 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866168.64-142337926365273/source", "state": "file", "uid": 0} 2019-11-27T14:49:29.761 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:29 +0000 (0:00:01.140) 0:01:43.196 **** 2019-11-27T14:49:29.800 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-27T14:49:29.801 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => { "msg": "Host smithi156.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-27T14:49:29.841 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:29 +0000 (0:00:00.079) 0:01:43.276 **** 2019-11-27T14:49:29.878 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-27T14:49:29.880 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-27T14:49:29.916 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:29 +0000 (0:00:00.075) 0:01:43.351 **** 2019-11-27T14:49:29.921 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:29.922 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-27T14:49:29.945 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-27T14:49:29.946 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:29.985 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:29 +0000 (0:00:00.068) 0:01:43.420 **** 2019-11-27T14:49:30.240 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:30.242 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-27T14:49:30.432 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-27T14:49:30.434 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.110973", "end": "2019-11-27 14:49:30.403808", "rc": 0, "start": "2019-11-27 14:49:30.292835", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-27T14:49:30.468 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.482) 0:01:43.903 **** 2019-11-27T14:49:30.493 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-27T14:49:30.495 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.533 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.064) 0:01:43.968 **** 2019-11-27T14:49:30.558 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-27T14:49:30.559 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.601 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.068) 0:01:44.037 **** 2019-11-27T14:49:30.606 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-27T14:49:30.607 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-27T14:49:30.659 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.057) 0:01:44.094 **** 2019-11-27T14:49:30.665 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-27T14:49:30.667 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.706 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.047) 0:01:44.142 **** 2019-11-27T14:49:30.733 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-27T14:49:30.734 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.771 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.064) 0:01:44.206 **** 2019-11-27T14:49:30.807 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-27T14:49:30.809 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.845 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.074) 0:01:44.281 **** 2019-11-27T14:49:30.871 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-27T14:49:30.873 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:30.909 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.063) 0:01:44.345 **** 2019-11-27T14:49:30.947 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-27T14:49:30.948 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:30.983 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:30 +0000 (0:00:00.073) 0:01:44.418 **** 2019-11-27T14:49:31.009 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-27T14:49:31.010 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.047 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.063) 0:01:44.482 **** 2019-11-27T14:49:31.073 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-27T14:49:31.074 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.108 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.061) 0:01:44.544 **** 2019-11-27T14:49:31.134 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-27T14:49:31.136 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:31.174 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.065) 0:01:44.609 **** 2019-11-27T14:49:31.200 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-27T14:49:31.202 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.064) 0:01:44.674 **** 2019-11-27T14:49:31.264 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-27T14:49:31.266 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:31.304 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.065) 0:01:44.739 **** 2019-11-27T14:49:31.329 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-27T14:49:31.330 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.366 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.062) 0:01:44.802 **** 2019-11-27T14:49:31.392 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-27T14:49:31.394 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.432 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.065) 0:01:44.867 **** 2019-11-27T14:49:31.457 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-27T14:49:31.459 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.495 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.063) 0:01:44.930 **** 2019-11-27T14:49:31.521 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-27T14:49:31.523 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.558 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.063) 0:01:44.994 **** 2019-11-27T14:49:31.584 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-27T14:49:31.586 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:31.621 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.063) 0:01:45.057 **** 2019-11-27T14:49:31.647 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-27T14:49:31.649 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.683 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.061) 0:01:45.119 **** 2019-11-27T14:49:31.708 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-27T14:49:31.709 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.743 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.059) 0:01:45.179 **** 2019-11-27T14:49:31.758 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-27T14:49:31.759 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866170.68-108828269435190/source", "state": "file", "uid": 0} 2019-11-27T14:49:31.795 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.051) 0:01:45.230 **** 2019-11-27T14:49:31.800 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-27T14:49:31.800 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.837 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.041) 0:01:45.272 **** 2019-11-27T14:49:31.841 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-27T14:49:31.841 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => { "msg": "Host smithi003.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-27T14:49:31.878 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.040) 0:01:45.313 **** 2019-11-27T14:49:31.884 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-27T14:49:31.885 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:31.936 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.058) 0:01:45.372 **** 2019-11-27T14:49:31.942 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-27T14:49:31.942 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-27T14:49:31.980 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:31 +0000 (0:00:00.043) 0:01:45.415 **** 2019-11-27T14:49:31.985 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-27T14:49:31.985 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.030 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.049) 0:01:45.465 **** 2019-11-27T14:49:32.035 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-27T14:49:32.035 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.072 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.042) 0:01:45.508 **** 2019-11-27T14:49:32.077 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-27T14:49:32.078 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.114 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.041) 0:01:45.550 **** 2019-11-27T14:49:32.139 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-27T14:49:32.141 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:32.176 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.061) 0:01:45.611 **** 2019-11-27T14:49:32.201 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-27T14:49:32.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.061) 0:01:45.673 **** 2019-11-27T14:49:32.263 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-27T14:49:32.265 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.299 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.061) 0:01:45.735 **** 2019-11-27T14:49:32.490 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-27T14:49:32.490 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.102377", "end": "2019-11-27 14:49:32.461844", "rc": 0, "start": "2019-11-27 14:49:32.359467", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-27T14:49:32.527 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.227) 0:01:45.962 **** 2019-11-27T14:49:32.554 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-27T14:49:32.555 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.590 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.063) 0:01:46.026 **** 2019-11-27T14:49:32.616 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-27T14:49:32.617 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.653 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.062) 0:01:46.088 **** 2019-11-27T14:49:32.658 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-27T14:49:32.659 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:49:32.696 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.043) 0:01:46.132 **** 2019-11-27T14:49:32.701 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-27T14:49:32.701 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.739 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.043) 0:01:46.175 **** 2019-11-27T14:49:32.765 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-27T14:49:32.767 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.801 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.061) 0:01:46.237 **** 2019-11-27T14:49:32.831 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-27T14:49:32.833 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.869 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.067) 0:01:46.304 **** 2019-11-27T14:49:32.894 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-27T14:49:32.896 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:32.930 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.061) 0:01:46.366 **** 2019-11-27T14:49:32.967 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-27T14:49:32.967 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:32.969 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:33.003 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:32 +0000 (0:00:00.072) 0:01:46.439 **** 2019-11-27T14:49:33.031 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.065 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.061) 0:01:46.501 **** 2019-11-27T14:49:33.091 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-27T14:49:33.092 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.127 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.061) 0:01:46.563 **** 2019-11-27T14:49:33.153 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-27T14:49:33.154 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:33.189 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.061) 0:01:46.624 **** 2019-11-27T14:49:33.215 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-27T14:49:33.217 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.253 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.063) 0:01:46.688 **** 2019-11-27T14:49:33.280 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-27T14:49:33.281 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:33.316 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.063) 0:01:46.752 **** 2019-11-27T14:49:33.343 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-27T14:49:33.345 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.382 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.065) 0:01:46.817 **** 2019-11-27T14:49:33.408 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-27T14:49:33.410 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.445 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.063) 0:01:46.881 **** 2019-11-27T14:49:33.472 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-27T14:49:33.474 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.509 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.063) 0:01:46.945 **** 2019-11-27T14:49:33.535 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-27T14:49:33.537 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.573 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.064) 0:01:47.009 **** 2019-11-27T14:49:33.601 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:33.639 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.065) 0:01:47.074 **** 2019-11-27T14:49:33.667 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-27T14:49:33.669 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.707 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.068) 0:01:47.142 **** 2019-11-27T14:49:33.749 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-27T14:49:33.751 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.786 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.078) 0:01:47.221 **** 2019-11-27T14:49:33.823 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.858 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.072) 0:01:47.293 **** 2019-11-27T14:49:33.874 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T14:49:33.875 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-27T14:49:33.887 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-27T14:49:33.888 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.923 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.065) 0:01:47.359 **** 2019-11-27T14:49:33.950 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-27T14:49:33.952 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:33.987 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:33 +0000 (0:00:00.064) 0:01:47.423 **** 2019-11-27T14:49:34.014 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-27T14:49:34.016 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:34.051 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.063) 0:01:47.487 **** 2019-11-27T14:49:34.078 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-27T14:49:34.079 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-27T14:49:34.115 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.063) 0:01:47.550 **** 2019-11-27T14:49:34.142 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-27T14:49:34.180 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.064) 0:01:47.615 **** 2019-11-27T14:49:34.207 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-27T14:49:34.209 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:34.243 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.063) 0:01:47.678 **** 2019-11-27T14:49:34.594 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-27T14:49:34.596 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:49:34.632 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.388) 0:01:48.067 **** 2019-11-27T14:49:34.794 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T14:49:34.795 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-27T14:49:34.834 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:34 +0000 (0:00:00.202) 0:01:48.269 **** 2019-11-27T14:49:35.643 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-27T14:49:35.966 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi156.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866174.87-113293109110395/source", "state": "file", "uid": 0} 2019-11-27T14:49:36.591 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-27T14:49:36.592 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-27T14:49:36.650 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:36 +0000 (0:00:01.816) 0:01:50.086 **** 2019-11-27T14:49:37.024 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi156.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866175.97-153295864470520/source", "state": "file", "uid": 0} 2019-11-27T14:49:37.061 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:37 +0000 (0:00:00.411) 0:01:50.497 **** 2019-11-27T14:49:37.639 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-27T14:49:37.639 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-27T14:49:37.816 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-27T14:49:37.818 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866176.68-154385837658393/source", "state": "file", "uid": 0} 2019-11-27T14:49:37.921 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-27T14:49:37.922 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T14:49:37.924 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-27T14:49:37.963 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:37 +0000 (0:00:00.901) 0:01:51.399 **** 2019-11-27T14:49:38.902 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-27T14:49:38.903 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574866177.83-95823953193613/source", "state": "file", "uid": 0} 2019-11-27T14:49:38.943 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:38 +0000 (0:00:00.980) 0:01:52.379 **** 2019-11-27T14:49:39.295 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-27T14:49:39.296 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-27T14:49:39.607 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T14:49:39.647 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:39 +0000 (0:00:00.703) 0:01:53.083 **** 2019-11-27T14:49:54.881 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-27T14:49:54.882 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-27T14:49:54.884 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:14.907217", "end": "2019-11-27 14:49:54.852046", "rc": 0, "start": "2019-11-27 14:49:39.944829", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.math.princeton.edu\n * extras: mirror.jaleco.com\n * updates: repo1.ash.innoscale.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.math.princeton.edu", " * extras: mirror.jaleco.com", " * updates: repo1.ash.innoscale.net", "Metadata Cache Created"]} 2019-11-27T14:49:54.939 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:54 +0000 (0:00:15.291) 0:02:08.374 **** 2019-11-27T14:49:55.269 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-27T14:49:55.270 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-27T14:49:55.584 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T14:49:55.626 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.686) 0:02:09.061 **** 2019-11-27T14:49:55.653 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T14:49:55.655 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:55.694 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.068) 0:02:09.129 **** 2019-11-27T14:49:55.721 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-27T14:49:55.723 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:55.762 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.067) 0:02:09.197 **** 2019-11-27T14:49:55.791 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-27T14:49:55.793 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:55.832 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.070) 0:02:09.268 **** 2019-11-27T14:49:55.863 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T14:49:55.865 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:55.906 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.073) 0:02:09.341 **** 2019-11-27T14:49:55.935 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-27T14:49:55.936 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:55.975 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:55 +0000 (0:00:00.068) 0:02:09.410 **** 2019-11-27T14:49:56.004 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-27T14:49:56.005 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:56.046 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:56 +0000 (0:00:00.071) 0:02:09.482 **** 2019-11-27T14:49:56.074 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-27T14:49:56.075 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:56.117 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:56 +0000 (0:00:00.070) 0:02:09.552 **** 2019-11-27T14:49:56.149 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-27T14:49:56.150 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:56.189 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:56 +0000 (0:00:00.072) 0:02:09.625 **** 2019-11-27T14:49:57.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-27T14:49:57.528 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.012928", "end": "2019-11-27 14:49:57.500337", "rc": 0, "start": "2019-11-27 14:49:56.487409", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:49:57.570 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:57 +0000 (0:00:01.381) 0:02:11.006 **** 2019-11-27T14:49:58.402 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-27T14:49:58.404 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-27T14:49:58.437 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:58 +0000 (0:00:00.866) 0:02:11.872 **** 2019-11-27T14:49:58.578 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:58.726 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:58 +0000 (0:00:00.289) 0:02:12.161 **** 2019-11-27T14:49:58.752 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-27T14:49:58.754 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:58.789 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:58 +0000 (0:00:00.063) 0:02:12.225 **** 2019-11-27T14:49:58.816 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-27T14:49:58.817 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:58.854 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:58 +0000 (0:00:00.063) 0:02:12.288 **** 2019-11-27T14:49:58.878 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-27T14:49:58.880 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:49:58.915 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:58 +0000 (0:00:00.062) 0:02:12.350 **** 2019-11-27T14:49:59.846 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-27T14:49:59.847 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-27T14:49:59.884 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:49:59 +0000 (0:00:00.969) 0:02:13.320 **** 2019-11-27T14:50:05.381 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-27T14:50:05.382 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-27T14:50:05.421 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:05 +0000 (0:00:05.536) 0:02:18.856 **** 2019-11-27T14:50:06.389 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-27T14:50:06.389 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-27T14:50:07.236 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-27T14:50:08.094 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-27T14:50:08.144 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:08 +0000 (0:00:02.723) 0:02:21.579 **** 2019-11-27T14:50:08.440 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-27T14:50:08.440 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:50:08.478 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:08 +0000 (0:00:00.333) 0:02:21.913 **** 2019-11-27T14:50:09.378 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-27T14:50:09.380 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-27T14:50:10.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-27T14:50:11.193 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-27T14:50:11.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:11 +0000 (0:00:02.759) 0:02:24.673 **** 2019-11-27T14:50:11.263 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-27T14:50:11.265 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:11.302 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:11 +0000 (0:00:00.064) 0:02:24.737 **** 2019-11-27T14:50:11.338 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-27T14:50:11.340 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-27T14:50:11.375 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:11 +0000 (0:00:00.073) 0:02:24.810 **** 2019-11-27T14:50:11.695 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-27T14:50:11.697 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-27T14:50:11.737 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:11 +0000 (0:00:00.361) 0:02:25.172 **** 2019-11-27T14:50:11.774 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-27T14:50:11.775 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:50:11.785 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:50:11.796 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:50:11.817 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:50:11.855 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:11 +0000 (0:00:00.118) 0:02:25.291 **** 2019-11-27T14:50:15.270 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-27T14:50:15.270 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-27T14:50:15.307 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:15 +0000 (0:00:03.451) 0:02:28.742 **** 2019-11-27T14:50:15.332 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-27T14:50:15.334 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:15.369 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:15 +0000 (0:00:00.062) 0:02:28.805 **** 2019-11-27T14:50:16.267 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-27T14:50:16.269 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-27T14:50:16.304 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:16 +0000 (0:00:00.934) 0:02:29.739 **** 2019-11-27T14:50:17.182 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-27T14:50:17.183 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-27T14:50:17.220 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:17 +0000 (0:00:00.915) 0:02:30.655 **** 2019-11-27T14:50:17.245 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-27T14:50:17.247 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:17.283 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:17 +0000 (0:00:00.062) 0:02:30.718 **** 2019-11-27T14:50:17.599 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-27T14:50:17.601 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:50:17.637 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:17 +0000 (0:00:00.354) 0:02:31.072 **** 2019-11-27T14:50:18.009 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-27T14:50:18.010 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-27T14:50:18.046 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:18 +0000 (0:00:00.408) 0:02:31.481 **** 2019-11-27T14:50:18.071 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-27T14:50:18.073 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:18.106 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:18 +0000 (0:00:00.059) 0:02:31.541 **** 2019-11-27T14:50:19.056 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-27T14:50:19.058 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-27T14:50:19.094 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:19 +0000 (0:00:00.988) 0:02:32.529 **** 2019-11-27T14:50:19.871 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-27T14:50:19.873 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-11-27 14:47:24 UTC", "ActiveEnterTimestampMonotonic": "19112246", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target time-sync.target basic.target systemd-journald.socket var-run.mount system.slice nss-lookup.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-11-27 14:47:24 UTC", "AssertTimestampMonotonic": "19111503", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-11-27 14:47:24 UTC", "ConditionTimestampMonotonic": "19111503", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8722", "ExecMainStartTimestamp": "Wed 2019-11-27 14:47:24 UTC", "ExecMainStartTimestampMonotonic": "19112168", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-27T14:50:19.875 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Wed 2019-11-27 14:47:24 UTC] ; stop_time=[n/a] ; pid=8722 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-11-27 14:47:24 UTC", "InactiveExitTimestampMonotonic": "19112246", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8722", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-27T14:50:19.876 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-11-27 14:47:24 UTC", "WatchdogTimestampMonotonic": "19112218", "WatchdogUSec": "0"}} 2019-11-27T14:50:19.910 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:19 +0000 (0:00:00.815) 0:02:33.345 **** 2019-11-27T14:50:20.246 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-27T14:50:20.247 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004808", "end": "2019-11-27 14:50:20.212478", "rc": 0, "start": "2019-11-27 14:50:20.207670", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-27T14:50:20.285 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:20 +0000 (0:00:00.375) 0:02:33.721 **** 2019-11-27T14:50:20.797 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-27T14:50:20.799 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-27T14:50:20.837 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:20 +0000 (0:00:00.551) 0:02:34.272 **** 2019-11-27T14:50:23.360 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-27T14:50:23.361 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-27T14:50:23.397 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:23 +0000 (0:00:02.560) 0:02:36.832 **** 2019-11-27T14:50:24.720 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-27T14:50:24.721 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-27T14:50:24.758 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:24 +0000 (0:00:01.361) 0:02:38.193 **** 2019-11-27T14:50:33.769 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-27T14:50:33.771 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.673381", "end": "2019-11-27 14:50:33.729713", "failed_when_result": false, "rc": 0, "start": "2019-11-27 14:50:25.056332", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-27T14:50:33.806 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:33 +0000 (0:00:09.048) 0:02:47.241 **** 2019-11-27T14:50:34.786 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-27T14:50:34.787 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-27T14:50:34.823 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:34 +0000 (0:00:01.016) 0:02:48.258 **** 2019-11-27T14:50:35.151 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-27T14:50:35.152 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010302", "end": "2019-11-27 14:50:35.122902", "rc": 0, "start": "2019-11-27 14:50:35.112600", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-27T14:50:35.189 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:35 +0000 (0:00:00.365) 0:02:48.624 **** 2019-11-27T14:50:35.528 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-27T14:50:35.530 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.015152", "end": "2019-11-27 14:50:35.499896", "rc": 0, "start": "2019-11-27 14:50:35.484744", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:50:35.565 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:35 +0000 (0:00:00.376) 0:02:49.001 **** 2019-11-27T14:50:44.394 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.497550", "end": "2019-11-27 14:50:44.357079", "rc": 0, "start": "2019-11-27 14:50:35.859529", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:50:44.430 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:44 +0000 (0:00:08.864) 0:02:57.865 **** 2019-11-27T14:50:44.793 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-27T14:50:44.795 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-27T14:50:44.833 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:44 +0000 (0:00:00.402) 0:02:58.268 **** 2019-11-27T14:50:44.861 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-27T14:50:44.862 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-27T14:50:44.899 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:44 +0000 (0:00:00.066) 0:02:58.334 **** 2019-11-27T14:50:44.936 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-27T14:50:44.937 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T14:50:44.976 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:44 +0000 (0:00:00.076) 0:02:58.411 **** 2019-11-27T14:50:45.013 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-27T14:50:45.014 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-27T14:50:45.052 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.076) 0:02:58.488 **** 2019-11-27T14:50:45.090 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-27T14:50:45.091 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T14:50:45.129 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.076) 0:02:58.564 **** 2019-11-27T14:50:45.436 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-27T14:50:45.437 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T14:50:45.474 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.345) 0:02:58.910 **** 2019-11-27T14:50:45.803 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-27T14:50:45.805 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-27T14:50:45.841 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.366) 0:02:59.277 **** 2019-11-27T14:50:45.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-27T14:50:45.870 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:45.915 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.071) 0:02:59.348 **** 2019-11-27T14:50:45.939 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-27T14:50:45.941 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:50:45.979 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:45 +0000 (0:00:00.063) 0:02:59.412 **** 2019-11-27T14:50:46.338 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-27T14:50:46.339 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-27T14:50:46.382 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:46 +0000 (0:00:00.405) 0:02:59.818 **** 2019-11-27T14:50:47.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-27T14:50:47.411 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-27T14:50:47.451 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:47 +0000 (0:00:01.068) 0:03:00.887 **** 2019-11-27T14:50:47.478 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-27T14:50:47.479 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi003"}, "changed": false} 2019-11-27T14:50:47.515 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:47 +0000 (0:00:00.063) 0:03:00.950 **** 2019-11-27T14:50:48.514 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-27T14:50:48.516 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi003.front.sepia.ceph.com", "ansible_hostname": "smithi003", "ansible_nodename": "smithi003"}, "changed": true, "name": "smithi003"} 2019-11-27T14:50:48.551 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:48 +0000 (0:00:01.036) 0:03:01.987 **** 2019-11-27T14:50:49.489 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-27T14:50:49.491 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-27T14:50:49.528 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:49 +0000 (0:00:00.976) 0:03:02.963 **** 2019-11-27T14:50:50.445 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-27T14:50:50.446 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-27T14:50:50.487 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:50 +0000 (0:00:00.958) 0:03:03.922 **** 2019-11-27T14:50:51.489 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-27T14:50:51.491 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-27T14:50:51.528 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:51 +0000 (0:00:01.041) 0:03:04.963 **** 2019-11-27T14:50:52.456 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-27T14:50:52.456 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-27T14:50:52.495 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:52 +0000 (0:00:00.967) 0:03:05.931 **** 2019-11-27T14:50:52.817 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T14:50:52.817 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T14:50:52.855 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:52 +0000 (0:00:00.359) 0:03:06.290 **** 2019-11-27T14:50:53.174 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T14:50:53.176 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-27T14:50:53.211 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:53 +0000 (0:00:00.356) 0:03:06.646 **** 2019-11-27T14:50:53.553 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T14:50:53.555 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-27T14:50:53.592 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:53 +0000 (0:00:00.381) 0:03:07.028 **** 2019-11-27T14:50:54.546 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T14:50:54.546 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-27T14:50:54.589 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:54 +0000 (0:00:00.996) 0:03:08.024 **** 2019-11-27T14:50:55.539 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T14:50:55.539 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-27T14:50:55.577 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:55 +0000 (0:00:00.988) 0:03:09.013 **** 2019-11-27T14:50:57.961 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T14:50:57.963 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.049389", "end": "2019-11-27 14:50:57.928563", "rc": 0, "start": "2019-11-27 14:50:55.879174", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:50:58.000 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:57 +0000 (0:00:02.422) 0:03:11.436 **** 2019-11-27T14:50:58.027 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-27T14:50:58.065 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:58 +0000 (0:00:00.064) 0:03:11.500 **** 2019-11-27T14:50:58.996 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-27T14:50:58.997 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-27T14:50:59.900 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-27T14:50:59.943 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:50:59 +0000 (0:00:01.877) 0:03:13.378 **** 2019-11-27T14:50:59.970 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-27T14:50:59.971 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:00.009 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:00 +0000 (0:00:00.066) 0:03:13.444 **** 2019-11-27T14:51:00.057 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-27T14:51:00.059 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:00.071 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:00.111 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:00 +0000 (0:00:00.101) 0:03:13.546 **** 2019-11-27T14:51:00.138 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-27T14:51:00.140 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:00.176 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:00 +0000 (0:00:00.064) 0:03:13.611 **** 2019-11-27T14:51:00.213 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:51:00.215 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-27T14:51:00.252 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:00 +0000 (0:00:00.076) 0:03:13.688 **** 2019-11-27T14:51:00.747 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-27T14:51:00.749 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-27T14:51:00.784 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:00 +0000 (0:00:00.532) 0:03:14.220 **** 2019-11-27T14:51:01.478 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-27T14:51:01.479 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.339366", "end": "2019-11-27 14:51:01.436999", "rc": 0, "start": "2019-11-27 14:51:01.097633", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.math.princeton.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: repo1.ash.innoscale.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.math.princeton.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.jaleco.com", " * updates: repo1.ash.innoscale.net", "No unfinished transactions left."]} 2019-11-27T14:51:01.522 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:01 +0000 (0:00:00.737) 0:03:14.958 **** 2019-11-27T14:51:01.912 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-27T14:51:01.913 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.057837", "end": "2019-11-27 14:51:01.876113", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 14:51:01.818276", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-27T14:51:01.950 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:01 +0000 (0:00:00.427) 0:03:15.386 **** 2019-11-27T14:51:01.977 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-27T14:51:01.979 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:02.018 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:02 +0000 (0:00:00.067) 0:03:15.454 **** 2019-11-27T14:51:12.129 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T14:51:12.130 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-27T14:51:12.132 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-27T14:51:12.133 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T14:51:12.167 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:12 +0000 (0:00:10.148) 0:03:25.602 **** 2019-11-27T14:51:16.109 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-27T14:51:16.110 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-27T14:51:16.150 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:16 +0000 (0:00:03.982) 0:03:29.585 **** 2019-11-27T14:51:35.222 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T14:51:35.223 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-27T14:51:35.225 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-27T14:51:35.226 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.math.princeton.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: repo1.ash.innoscale.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies 2019-11-27T14:51:35.227 INFO:teuthology.task.ansible.out:Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 22 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-27T14:51:35.229 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.e 2019-11-27T14:51:35.230 INFO:teuthology.task.ansible.out:l7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T14:51:35.267 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:35 +0000 (0:00:19.117) 0:03:48.702 **** 2019-11-27T14:51:36.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-27T14:51:36.073 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-27T14:51:36.109 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:36 +0000 (0:00:00.842) 0:03:49.544 **** 2019-11-27T14:51:36.653 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T14:51:36.654 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-27T14:51:36.690 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:36 +0000 (0:00:00.580) 0:03:50.125 **** 2019-11-27T14:51:36.726 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:51:36.728 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:36.763 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:36 +0000 (0:00:00.072) 0:03:50.198 **** 2019-11-27T14:51:37.176 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-27T14:51:37.177 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service polkit.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ebtables.service ip6tables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-27T14:51:37.179 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-27T14:51:37.180 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T14:51:37.214 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:37 +0000 (0:00:00.451) 0:03:50.649 **** 2019-11-27T14:51:37.624 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-27T14:51:37.626 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-27T14:51:37.661 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:37 +0000 (0:00:00.446) 0:03:51.096 **** 2019-11-27T14:51:38.446 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-27T14:51:38.448 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-27T14:51:38.481 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.820) 0:03:51.917 **** 2019-11-27T14:51:38.507 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-27T14:51:38.509 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.544 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.062) 0:03:51.979 **** 2019-11-27T14:51:38.570 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-27T14:51:38.608 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.063) 0:03:52.043 **** 2019-11-27T14:51:38.634 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-27T14:51:38.635 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.670 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.062) 0:03:52.106 **** 2019-11-27T14:51:38.695 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-27T14:51:38.697 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.731 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.060) 0:03:52.166 **** 2019-11-27T14:51:38.767 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-27T14:51:38.769 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.806 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.075) 0:03:52.242 **** 2019-11-27T14:51:38.832 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-27T14:51:38.833 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.867 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.060) 0:03:52.302 **** 2019-11-27T14:51:38.893 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-27T14:51:38.929 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.062) 0:03:52.364 **** 2019-11-27T14:51:38.955 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-27T14:51:38.956 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:38.991 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:38 +0000 (0:00:00.061) 0:03:52.426 **** 2019-11-27T14:51:39.016 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-27T14:51:39.018 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.054 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.063) 0:03:52.489 **** 2019-11-27T14:51:39.080 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-27T14:51:39.081 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.117 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.062) 0:03:52.552 **** 2019-11-27T14:51:39.141 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:51:39.143 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.179 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.062) 0:03:52.614 **** 2019-11-27T14:51:39.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-27T14:51:39.206 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.240 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.061) 0:03:52.676 **** 2019-11-27T14:51:39.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T14:51:39.267 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.303 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.062) 0:03:52.738 **** 2019-11-27T14:51:39.304 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:39.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-27T14:51:39.331 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.367 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.062) 0:03:52.801 **** 2019-11-27T14:51:39.391 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-27T14:51:39.392 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.426 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.061) 0:03:52.862 **** 2019-11-27T14:51:39.452 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-27T14:51:39.454 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.486 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.059) 0:03:52.922 **** 2019-11-27T14:51:39.511 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-27T14:51:39.513 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.546 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.060) 0:03:52.982 **** 2019-11-27T14:51:39.572 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-27T14:51:39.574 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.607 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.060) 0:03:53.043 **** 2019-11-27T14:51:39.633 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-27T14:51:39.635 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.668 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.061) 0:03:53.104 **** 2019-11-27T14:51:39.694 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-27T14:51:39.696 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.729 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.060) 0:03:53.164 **** 2019-11-27T14:51:39.764 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.806 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.077) 0:03:53.242 **** 2019-11-27T14:51:39.833 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T14:51:39.834 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.869 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.062) 0:03:53.304 **** 2019-11-27T14:51:39.895 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T14:51:39.896 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.933 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.064) 0:03:53.368 **** 2019-11-27T14:51:39.959 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T14:51:39.960 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:39.997 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:39 +0000 (0:00:00.064) 0:03:53.433 **** 2019-11-27T14:51:40.024 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T14:51:40.025 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.062 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.064) 0:03:53.497 **** 2019-11-27T14:51:40.089 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T14:51:40.089 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.127 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.064) 0:03:53.562 **** 2019-11-27T14:51:40.154 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T14:51:40.155 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.193 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.066) 0:03:53.629 **** 2019-11-27T14:51:40.220 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T14:51:40.221 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.259 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.065) 0:03:53.695 **** 2019-11-27T14:51:40.286 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-27T14:51:40.287 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.326 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.066) 0:03:53.761 **** 2019-11-27T14:51:40.353 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T14:51:40.354 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.392 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.065) 0:03:53.827 **** 2019-11-27T14:51:40.419 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T14:51:40.419 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.457 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.065) 0:03:53.893 **** 2019-11-27T14:51:40.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:51:40.485 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.523 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.065) 0:03:53.958 **** 2019-11-27T14:51:40.524 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:40.549 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T14:51:40.550 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:40.586 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.063) 0:03:54.021 **** 2019-11-27T14:51:40.914 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T14:51:40.916 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-27T14:51:40.951 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:40 +0000 (0:00:00.364) 0:03:54.386 **** 2019-11-27T14:51:41.300 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T14:51:41.301 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:51:41.338 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.387) 0:03:54.774 **** 2019-11-27T14:51:41.665 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T14:51:41.666 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-27T14:51:41.703 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.365) 0:03:55.139 **** 2019-11-27T14:51:41.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T14:51:41.732 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:41.767 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.063) 0:03:55.203 **** 2019-11-27T14:51:41.794 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T14:51:41.795 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:41.831 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.063) 0:03:55.266 **** 2019-11-27T14:51:41.857 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T14:51:41.859 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:41.894 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.063) 0:03:55.330 **** 2019-11-27T14:51:41.920 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T14:51:41.922 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:41.957 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:41 +0000 (0:00:00.063) 0:03:55.393 **** 2019-11-27T14:51:41.983 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T14:51:41.984 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.020 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.062) 0:03:55.455 **** 2019-11-27T14:51:42.047 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.049 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.084 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.064) 0:03:55.520 **** 2019-11-27T14:51:42.086 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.111 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.113 INFO:teuthology.task.ansible.out:TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.150 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.065) 0:03:55.585 **** 2019-11-27T14:51:42.151 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.177 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.179 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.214 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.064) 0:03:55.649 **** 2019-11-27T14:51:42.215 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:42.254 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.295 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.080) 0:03:55.730 **** 2019-11-27T14:51:42.322 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-27T14:51:42.323 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.363 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.068) 0:03:55.799 **** 2019-11-27T14:51:42.389 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-27T14:51:42.390 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.429 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.066) 0:03:55.865 **** 2019-11-27T14:51:42.457 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T14:51:42.458 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.494 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.065) 0:03:55.930 **** 2019-11-27T14:51:42.521 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T14:51:42.522 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.563 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.068) 0:03:55.998 **** 2019-11-27T14:51:42.589 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-27T14:51:42.590 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.627 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.064) 0:03:56.062 **** 2019-11-27T14:51:42.654 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-27T14:51:42.655 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.695 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.067) 0:03:56.130 **** 2019-11-27T14:51:42.723 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-27T14:51:42.723 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.761 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.066) 0:03:56.197 **** 2019-11-27T14:51:42.788 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-27T14:51:42.788 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.826 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.064) 0:03:56.261 **** 2019-11-27T14:51:42.852 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-27T14:51:42.853 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.888 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.062) 0:03:56.324 **** 2019-11-27T14:51:42.915 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-27T14:51:42.915 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:42.954 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:42 +0000 (0:00:00.065) 0:03:56.389 **** 2019-11-27T14:51:42.980 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-27T14:51:42.981 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.017 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.063) 0:03:56.452 **** 2019-11-27T14:51:43.043 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-27T14:51:43.044 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.080 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.063) 0:03:56.516 **** 2019-11-27T14:51:43.106 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-27T14:51:43.107 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.144 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.063) 0:03:56.580 **** 2019-11-27T14:51:43.172 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:51:43.173 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-27T14:51:43.219 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.074) 0:03:56.654 **** 2019-11-27T14:51:43.257 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-27T14:51:43.258 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.269 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-27T14:51:43.281 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.281 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.293 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.304 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.315 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.359 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.139) 0:03:56.794 **** 2019-11-27T14:51:43.500 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-27T14:51:43.501 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003672", "end": "2019-11-27 14:51:43.482961", "rc": 0, "start": "2019-11-27 14:51:43.479289", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-27T14:51:43.543 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.184) 0:03:56.978 **** 2019-11-27T14:51:43.569 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-27T14:51:43.570 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.610 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.067) 0:03:57.046 **** 2019-11-27T14:51:43.636 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-27T14:51:43.637 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.676 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.065) 0:03:57.111 **** 2019-11-27T14:51:43.703 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-27T14:51:43.703 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.741 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.065) 0:03:57.177 **** 2019-11-27T14:51:43.768 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-27T14:51:43.770 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:43.804 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:43 +0000 (0:00:00.062) 0:03:57.239 **** 2019-11-27T14:51:44.271 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-27T14:51:44.272 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-27T14:51:44.307 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:44 +0000 (0:00:00.503) 0:03:57.743 **** 2019-11-27T14:51:44.355 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T14:51:44.357 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={u'block_used': 13034944, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289540, u'size_available': 930977955840, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289540, "block_size": 4096, "block_total": 240324484, "block_used": 13034944, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977955840, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-27T14:51:44.405 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:44 +0000 (0:00:00.097) 0:03:57.840 **** 2019-11-27T14:51:44.737 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-27T14:51:44.739 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011790", "end": "2019-11-27 14:51:44.713222", "rc": 0, "start": "2019-11-27 14:51:44.701432", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:44.774 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:44 +0000 (0:00:00.369) 0:03:58.209 **** 2019-11-27T14:51:44.820 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-27T14:51:44.821 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'block_used': 13034944, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289540, u'size_available': 930977955840, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289540, "block_size": 4096, "block_total": 240324484, "block_used": 13034944, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977955840, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:44.863 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:44 +0000 (0:00:00.089) 0:03:58.299 **** 2019-11-27T14:51:44.890 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-27T14:51:44.927 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:44 +0000 (0:00:00.063) 0:03:58.362 **** 2019-11-27T14:51:44.964 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T14:51:44.965 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRN7', u'wwn-0x5000c500871a3370'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRN7', u'wwn': u'0x5000c500871a3370', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', u'wwn-0x5000c500871a3370-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T14:51:44.967 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:46.946 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Uxgmnx-9etf-9ibW-wgy5-jUBY-QI4g-iwgwaq', u'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', u'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.669510", "end": "2019-11-27 14:51:46.910865", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Uxgmnx-9etf-9ibW-wgy5-jUBY-QI4g-iwgwaq", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:45.241355", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-27T14:51:46.948 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:48.338 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4ufn2wFTTMIr5HXtLdvt6CA4KAr1wUV34'], u'uuids': [u'6dc366aa-5798-4821-a2c0-b9e614d6d638']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.055362", "end": "2019-11-27 14:51:48.303204", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4ufn2wFTTMIr5HXtLdvt6CA4KAr1wUV34"], "labels": [], "masters": [], "uuids": ["6dc366aa-5798-4821-a2c0-b9e614d6d638"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:47.247842", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:49.711 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk47ItZVZPdAnDkcXJEvdTgGinCLdzzyspx'], u'uuids': [u'340c8ec3-87f8-4915-a8ce-b75494eba56d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052449", "end": "2019-11-27 14:51:49.672937", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk47ItZVZPdAnDkcXJEvdTgGinCLdzzyspx"], "labels": [], "masters": [], "uuids": ["340c8ec3-87f8-4915-a8ce-b75494eba56d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:48.620488", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:51.070 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4LRlmjScf0HyBtWShb8H3sogRugPItUUR'], u'uuids': [u'47db68ff-1786-4e45-b1a8-d9ecd3f617dd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055355", "end": "2019-11-27 14:51:51.031621", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4LRlmjScf0HyBtWShb8H3sogRugPItUUR"], "labels": [], "masters": [], "uuids": ["47db68ff-1786-4e45-b1a8-d9ecd3f617dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:49.976266", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:52.446 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4JiH1GPAOsGhPGKUstxxlgxkkVb3Zkufz'], u'uuids': [u'4819437e-e1bc-4496-86cf-77181dfa8e69']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063803", "end": "2019-11-27 14:51:52.415281", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4JiH1GPAOsGhPGKUstxxlgxkkVb3Zkufz"], "labels": [], "masters": [], "uuids": ["4819437e-e1bc-4496-86cf-77181dfa8e69"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:51.351478", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:53.815 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4attkmVGPLVde3BII8rAtZL9bxmCnqIHK'], u'uuids': [u'8a348ba2-29d3-4e16-a65f-1c58dd8ad6a9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.052580", "end": "2019-11-27 14:51:53.774050", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4attkmVGPLVde3BII8rAtZL9bxmCnqIHK"], "labels": [], "masters": [], "uuids": ["8a348ba2-29d3-4e16-a65f-1c58dd8ad6a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:52.721470", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:51:53.859 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:53 +0000 (0:00:08.931) 0:04:07.294 **** 2019-11-27T14:51:53.896 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T14:51:53.897 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRN7', u'wwn-0x5000c500871a3370'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HRN7', u'wwn': u'0x5000c500871a3370', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', u'wwn-0x5000c500871a3370-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T14:51:53.898 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:54.270 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Uxgmnx-9etf-9ibW-wgy5-jUBY-QI4g-iwgwaq', u'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', u'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.069827", "end": "2019-11-27 14:51:54.241412", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Uxgmnx-9etf-9ibW-wgy5-jUBY-QI4g-iwgwaq", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:54.171585", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-27T14:51:54.271 INFO:teuthology.task.ansible.out:pied, 0.0630163 s, 1.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0630163 s, 1.8 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:54.714 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4ufn2wFTTMIr5HXtLdvt6CA4KAr1wUV34'], u'uuids': [u'6dc366aa-5798-4821-a2c0-b9e614d6d638']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.199427", "end": "2019-11-27 14:51:54.679032", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4ufn2wFTTMIr5HXtLdvt6CA4KAr1wUV34"], "labels": [], "masters": [], "uuids": ["6dc366aa-5798-4821-a2c0-b9e614d6d638"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:54.479605", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19372 s, 595 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19372 s, 595 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:55.202 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk47ItZVZPdAnDkcXJEvdTgGinCLdzzyspx'], u'uuids': [u'340c8ec3-87f8-4915-a8ce-b75494eba56d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.171602", "end": "2019-11-27 14:51:55.171249", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk47ItZVZPdAnDkcXJEvdTgGinCLdzzyspx"], "labels": [], "masters": [], "uuids": ["340c8ec3-87f8-4915-a8ce-b75494eba56d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:54.999647", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16545 s, 697 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16545 s, 697 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:55.667 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4LRlmjScf0HyBtWShb8H3sogRugPItUUR'], u'uuids': [u'47db68ff-1786-4e45-b1a8-d9ecd3f617dd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.164908", "end": "2019-11-27 14:51:55.637201", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4LRlmjScf0HyBtWShb8H3sogRugPItUUR"], "labels": [], "masters": [], "uuids": ["47db68ff-1786-4e45-b1a8-d9ecd3f617dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:55.472293", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.158508 s, 728 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.158508 s, 728 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:56.142 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4JiH1GPAOsGhPGKUstxxlgxkkVb3Zkufz'], u'uuids': [u'4819437e-e1bc-4496-86cf-77181dfa8e69']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.174383", "end": "2019-11-27 14:51:56.112988", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4JiH1GPAOsGhPGKUstxxlgxkkVb3Zkufz"], "labels": [], "masters": [], "uuids": ["4819437e-e1bc-4496-86cf-77181dfa8e69"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:55.938605", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.168191 s, 686 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.168191 s, 686 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:56.641 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4attkmVGPLVde3BII8rAtZL9bxmCnqIHK'], u'uuids': [u'8a348ba2-29d3-4e16-a65f-1c58dd8ad6a9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.189092", "end": "2019-11-27 14:51:56.596199", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-j7bs7kWzoNsNoHoAamuTweuXC2ZHnjk4attkmVGPLVde3BII8rAtZL9bxmCnqIHK"], "labels": [], "masters": [], "uuids": ["8a348ba2-29d3-4e16-a65f-1c58dd8ad6a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:51:56.407107", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.183277 s, 629 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.183277 s, 629 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:56.682 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:56 +0000 (0:00:02.823) 0:04:10.118 **** 2019-11-27T14:51:57.103 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.086183", "end": "2019-11-27 14:51:57.063405", "rc": 0, "start": "2019-11-27 14:51:56.977222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:57.139 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.457) 0:04:10.575 **** 2019-11-27T14:51:57.512 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.055865", "end": "2019-11-27 14:51:57.482476", "rc": 0, "start": "2019-11-27 14:51:57.426611", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:51:57.553 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.413) 0:04:10.989 **** 2019-11-27T14:51:57.580 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-27T14:51:57.621 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.067) 0:04:11.056 **** 2019-11-27T14:51:57.648 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-27T14:51:57.650 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:57.694 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.073) 0:04:11.130 **** 2019-11-27T14:51:57.721 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-27T14:51:57.723 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:57.763 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.068) 0:04:11.199 **** 2019-11-27T14:51:57.792 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:57.793 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:57.832 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.068) 0:04:11.267 **** 2019-11-27T14:51:57.861 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-27T14:51:57.862 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:57.904 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:57 +0000 (0:00:00.072) 0:04:11.340 **** 2019-11-27T14:51:57.906 INFO:teuthology.task.ansible.out: 2019-11-27T14:51:58.238 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-27T14:51:58.240 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:51:58.276 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.371) 0:04:11.711 **** 2019-11-27T14:51:58.324 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T14:51:58.326 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={u'block_used': 13034944, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289540, u'size_available': 930977955840, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289540, "block_size": 4096, "block_total": 240324484, "block_used": 13034944, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977955840, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.363 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.087) 0:04:11.799 **** 2019-11-27T14:51:58.393 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-27T14:51:58.395 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.435 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.071) 0:04:11.870 **** 2019-11-27T14:51:58.462 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:51:58.463 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.497 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.062) 0:04:11.933 **** 2019-11-27T14:51:58.523 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:51:58.525 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.560 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.062) 0:04:11.995 **** 2019-11-27T14:51:58.587 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-27T14:51:58.589 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.625 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.064) 0:04:12.060 **** 2019-11-27T14:51:58.652 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-27T14:51:58.654 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.689 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.064) 0:04:12.125 **** 2019-11-27T14:51:58.717 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-27T14:51:58.719 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:51:58.753 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:58 +0000 (0:00:00.063) 0:04:12.189 **** 2019-11-27T14:51:59.439 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-27T14:51:59.441 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-27T14:51:59.480 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:51:59 +0000 (0:00:00.726) 0:04:12.916 **** 2019-11-27T14:52:00.258 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T14:52:00.260 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:52:00.707 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:52:01.185 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:52:01.653 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:52:02.125 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:52:02.166 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:02 +0000 (0:00:02.685) 0:04:15.601 **** 2019-11-27T14:52:02.486 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-27T14:52:02.487 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-27T14:52:02.525 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:02 +0000 (0:00:00.359) 0:04:15.960 **** 2019-11-27T14:52:02.563 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T14:52:02.564 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:02.890 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:52:03.226 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:52:03.532 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:52:03.845 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:52:03.891 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:03 +0000 (0:00:01.365) 0:04:17.326 **** 2019-11-27T14:52:04.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-27T14:52:04.231 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:52:04.269 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:04 +0000 (0:00:00.378) 0:04:17.705 **** 2019-11-27T14:52:04.308 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-27T14:52:04.309 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-27T14:52:04.356 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:04 +0000 (0:00:00.086) 0:04:17.791 **** 2019-11-27T14:52:05.039 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-27T14:52:05.040 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true} 2019-11-27T14:52:05.088 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:05 +0000 (0:00:00.732) 0:04:18.523 **** 2019-11-27T14:52:05.800 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-27T14:52:05.802 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-27T14:52:05.839 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:05 +0000 (0:00:00.751) 0:04:19.275 **** 2019-11-27T14:52:05.866 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-27T14:52:05.867 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:05.905 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:05 +0000 (0:00:00.065) 0:04:19.340 **** 2019-11-27T14:52:05.931 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-27T14:52:05.933 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:05.976 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:05 +0000 (0:00:00.071) 0:04:19.412 **** 2019-11-27T14:52:06.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-27T14:52:06.005 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.043 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.066) 0:04:19.478 **** 2019-11-27T14:52:06.069 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-27T14:52:06.071 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.108 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.065) 0:04:19.544 **** 2019-11-27T14:52:06.135 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-27T14:52:06.137 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.178 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.069) 0:04:19.613 **** 2019-11-27T14:52:06.205 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-27T14:52:06.206 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.244 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.066) 0:04:19.679 **** 2019-11-27T14:52:06.270 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-27T14:52:06.272 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.312 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.068) 0:04:19.747 **** 2019-11-27T14:52:06.781 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-27T14:52:06.825 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.513) 0:04:20.261 **** 2019-11-27T14:52:06.855 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-27T14:52:06.857 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.892 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.066) 0:04:20.327 **** 2019-11-27T14:52:06.919 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-27T14:52:06.921 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:06.958 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:06 +0000 (0:00:00.065) 0:04:20.393 **** 2019-11-27T14:52:07.883 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-27T14:52:07.884 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-27T14:52:07.921 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:07 +0000 (0:00:00.963) 0:04:21.357 **** 2019-11-27T14:52:07.948 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-27T14:52:07.950 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:07.994 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:07 +0000 (0:00:00.072) 0:04:21.429 **** 2019-11-27T14:52:08.501 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-27T14:52:08.503 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount tmp.mount systemd-journald.socket basic.target system.slice ntpdate.service syslog.target sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-27T14:52:08.504 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-27T14:52:08.506 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T14:52:08.540 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:08 +0000 (0:00:00.545) 0:04:21.975 **** 2019-11-27T14:52:09.489 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-27T14:52:09.491 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-27T14:52:09.524 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:09 +0000 (0:00:00.984) 0:04:22.960 **** 2019-11-27T14:52:09.560 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-27T14:52:09.562 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:09.595 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:09 +0000 (0:00:00.070) 0:04:23.031 **** 2019-11-27T14:52:09.927 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-27T14:52:09.929 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-27T14:52:09.964 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:09 +0000 (0:00:00.368) 0:04:23.399 **** 2019-11-27T14:52:10.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-27T14:52:10.864 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-27T14:52:10.900 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:10 +0000 (0:00:00.936) 0:04:24.336 **** 2019-11-27T14:52:12.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-27T14:52:12.632 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-27T14:52:12.668 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:12 +0000 (0:00:01.767) 0:04:26.104 **** 2019-11-27T14:52:12.698 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-27T14:52:12.699 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:12.735 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:12 +0000 (0:00:00.066) 0:04:26.170 **** 2019-11-27T14:52:12.771 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-27T14:52:12.773 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-11-27T14:52:12.808 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:12 +0000 (0:00:00.073) 0:04:26.243 **** 2019-11-27T14:52:13.124 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-27T14:52:13.125 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-27T14:52:13.164 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:13 +0000 (0:00:00.355) 0:04:26.599 **** 2019-11-27T14:52:13.190 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-27T14:52:13.192 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:13.229 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:13 +0000 (0:00:00.064) 0:04:26.664 **** 2019-11-27T14:52:13.256 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-27T14:52:13.257 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-27T14:52:13.304 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:13 +0000 (0:00:00.075) 0:04:26.740 **** 2019-11-27T14:52:13.332 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-27T14:52:13.334 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:13.398 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:13 +0000 (0:00:00.093) 0:04:26.833 **** 2019-11-27T14:52:13.731 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-27T14:52:13.733 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-27T14:52:13.774 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:13 +0000 (0:00:00.375) 0:04:27.209 **** 2019-11-27T14:52:14.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-27T14:52:14.096 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-27T14:52:14.133 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.360) 0:04:27.569 **** 2019-11-27T14:52:14.160 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-27T14:52:14.162 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.202 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.068) 0:04:27.638 **** 2019-11-27T14:52:14.241 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-27T14:52:14.243 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.296 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.094) 0:04:27.732 **** 2019-11-27T14:52:14.338 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-27T14:52:14.339 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.341 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.351 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.352 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.363 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.405 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.108) 0:04:27.840 **** 2019-11-27T14:52:14.432 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:52:14.433 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.476 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.071) 0:04:27.912 **** 2019-11-27T14:52:14.508 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-27T14:52:14.510 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.551 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.074) 0:04:27.986 **** 2019-11-27T14:52:14.578 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-27T14:52:14.580 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.621 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.070) 0:04:28.057 **** 2019-11-27T14:52:14.649 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-27T14:52:14.650 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.694 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.073) 0:04:28.130 **** 2019-11-27T14:52:14.722 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-27T14:52:14.724 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.765 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.070) 0:04:28.200 **** 2019-11-27T14:52:14.792 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T14:52:14.794 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.834 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.069) 0:04:28.270 **** 2019-11-27T14:52:14.873 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-27T14:52:14.875 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.922 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.088) 0:04:28.358 **** 2019-11-27T14:52:14.924 INFO:teuthology.task.ansible.out: 2019-11-27T14:52:14.950 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T14:52:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:52:14.992 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:14 +0000 (0:00:00.069) 0:04:28.428 **** 2019-11-27T14:52:15.357 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-27T14:52:15.358 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015996", "end": "2019-11-27 14:52:15.314784", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-27 14:52:15.298788", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:52:15.673 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007030", "end": "2019-11-27 14:52:15.632612", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-27 14:52:15.625582", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:52:15.975 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006862", "end": "2019-11-27 14:52:15.932533", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 14:52:15.925671", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-27T14:52:16.309 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037906", "end": "2019-11-27 14:52:16.265090", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-27 14:52:16.227184", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:52:16.361 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:16 +0000 (0:00:01.368) 0:04:29.796 **** 2019-11-27T14:52:16.388 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-27T14:52:16.425 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:52:16 +0000 (0:00:00.064) 0:04:29.861 **** 2019-11-27T14:52:16.770 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-27T14:52:16.772 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T14:53:37.648 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-27T14:53:37.649 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:03:59.361486", "end": "2019-11-27 14:53:37.616405", "rc": 0, "start": "2019-11-27 14:49:38.254919", "stderr": "http://mirrors.cmich.edu/centos/7.7.1908/os/x86_64/repodata/04efe80d41ea3d94d36294f7107709d1c8f70db11e152d6ef562da344748581a-primary.sqlite.bz2: [Errno 14] curl#56 - \"Recv failure: Connection reset by peer\"\nTrying other mirror.", "stderr_lines": ["http://mirrors.cmich.edu/centos/7.7.1908/os/x86_64/repodata/04efe80d41ea3d94d36294f7107709d1c8f70db11e152d6ef562da344748581a-primary.sqlite.bz2: [Errno 14] curl#56 - \"Recv failure: Connection reset by peer\"", "Trying other mirror."], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.math.princeton.edu\n * extras: mirror.jaleco.com\n * updates: mirror.umd.edu\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.math.princeton.edu", " * extras: mirror.jaleco.com", " * updates: mirror.umd.edu", "Metadata Cache Created"]} 2019-11-27T14:53:37.683 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:37 +0000 (0:01:21.257) 0:05:51.118 **** 2019-11-27T14:53:38.071 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-27T14:53:38.071 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-27T14:53:38.382 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-27T14:53:38.419 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.736) 0:05:51.855 **** 2019-11-27T14:53:38.444 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T14:53:38.446 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.481 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.061) 0:05:51.917 **** 2019-11-27T14:53:38.507 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-27T14:53:38.508 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.543 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.061) 0:05:51.979 **** 2019-11-27T14:53:38.568 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-27T14:53:38.570 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.604 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.061) 0:05:52.040 **** 2019-11-27T14:53:38.629 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-27T14:53:38.631 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.664 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.060) 0:05:52.100 **** 2019-11-27T14:53:38.689 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-27T14:53:38.691 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.728 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.061) 0:05:52.162 **** 2019-11-27T14:53:38.751 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-27T14:53:38.753 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.788 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.061) 0:05:52.223 **** 2019-11-27T14:53:38.812 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-27T14:53:38.814 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.849 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.060) 0:05:52.284 **** 2019-11-27T14:53:38.873 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-27T14:53:38.875 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:38.909 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:38 +0000 (0:00:00.060) 0:05:52.344 **** 2019-11-27T14:53:40.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-27T14:53:40.527 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.316501", "end": "2019-11-27 14:53:40.500421", "rc": 0, "start": "2019-11-27 14:53:39.183920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:53:40.561 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:40 +0000 (0:00:01.652) 0:05:53.996 **** 2019-11-27T14:53:41.058 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-27T14:53:41.060 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-27T14:53:41.095 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:41 +0000 (0:00:00.534) 0:05:54.531 **** 2019-11-27T14:53:41.120 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-27T14:53:41.122 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:41.158 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:41 +0000 (0:00:00.063) 0:05:54.594 **** 2019-11-27T14:53:41.185 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-27T14:53:41.186 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:41.221 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:41 +0000 (0:00:00.062) 0:05:54.656 **** 2019-11-27T14:53:41.246 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-27T14:53:41.247 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:41.282 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:41 +0000 (0:00:00.061) 0:05:54.718 **** 2019-11-27T14:53:41.308 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-27T14:53:41.309 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:41.344 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:41 +0000 (0:00:00.061) 0:05:54.779 **** 2019-11-27T14:53:42.225 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-27T14:53:42.226 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-27T14:53:42.262 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:42 +0000 (0:00:00.918) 0:05:55.697 **** 2019-11-27T14:53:46.201 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-27T14:53:46.203 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-27T14:53:46.239 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:46 +0000 (0:00:03.976) 0:05:59.674 **** 2019-11-27T14:53:47.151 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-27T14:53:47.152 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-27T14:53:48.028 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-27T14:53:48.885 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-27T14:53:48.924 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:48 +0000 (0:00:02.685) 0:06:02.360 **** 2019-11-27T14:53:49.237 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-27T14:53:49.239 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:53:49.274 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:49 +0000 (0:00:00.350) 0:06:02.710 **** 2019-11-27T14:53:50.157 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-27T14:53:50.157 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-27T14:53:51.003 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-27T14:53:51.788 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-27T14:53:51.832 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:51 +0000 (0:00:02.557) 0:06:05.267 **** 2019-11-27T14:53:51.860 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-27T14:53:51.862 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:51.897 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:51 +0000 (0:00:00.064) 0:06:05.332 **** 2019-11-27T14:53:51.933 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-27T14:53:51.934 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-27T14:53:51.971 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:51 +0000 (0:00:00.073) 0:06:05.406 **** 2019-11-27T14:53:52.286 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-27T14:53:52.288 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-27T14:53:52.323 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:52 +0000 (0:00:00.352) 0:06:05.758 **** 2019-11-27T14:53:52.369 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-27T14:53:52.371 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:53:52.380 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:53:52.391 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:53:52.402 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-27T14:53:52.442 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:52 +0000 (0:00:00.118) 0:06:05.877 **** 2019-11-27T14:53:52.443 INFO:teuthology.task.ansible.out: 2019-11-27T14:53:55.794 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-27T14:53:55.795 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-27T14:53:55.834 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:55 +0000 (0:00:03.392) 0:06:09.269 **** 2019-11-27T14:53:55.859 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-27T14:53:55.861 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:55.900 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:55 +0000 (0:00:00.066) 0:06:09.335 **** 2019-11-27T14:53:56.781 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-27T14:53:56.781 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-27T14:53:56.818 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:56 +0000 (0:00:00.918) 0:06:10.254 **** 2019-11-27T14:53:57.753 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-27T14:53:57.754 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-27T14:53:57.814 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:57 +0000 (0:00:00.995) 0:06:11.249 **** 2019-11-27T14:53:57.840 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-27T14:53:57.842 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:57.877 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:57 +0000 (0:00:00.063) 0:06:11.313 **** 2019-11-27T14:53:58.213 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-27T14:53:58.214 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:53:58.251 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:58 +0000 (0:00:00.373) 0:06:11.686 **** 2019-11-27T14:53:58.595 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-27T14:53:58.597 INFO:teuthology.task.ansible.out:fatal: [smithi156.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-27T14:53:58.633 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:58 +0000 (0:00:00.382) 0:06:12.068 **** 2019-11-27T14:53:58.658 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-27T14:53:58.660 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:53:58.695 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:58 +0000 (0:00:00.062) 0:06:12.131 **** 2019-11-27T14:53:59.566 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-27T14:53:59.567 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-27T14:53:59.605 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:53:59 +0000 (0:00:00.909) 0:06:13.040 **** 2019-11-27T14:54:00.063 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-27T14:54:00.064 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-11-27 14:47:36 UTC", "ActiveEnterTimestampMonotonic": "19381674", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target nss-lookup.target time-sync.target network.target var-run.mount system.slice systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-11-27 14:47:36 UTC", "AssertTimestampMonotonic": "19381096", "Before": "shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-11-27 14:47:36 UTC", "ConditionTimestampMonotonic": "19381095", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8967", "ExecMainStartTimestamp": "Wed 2019-11-27 14:47:36 UTC", "ExecMainStartTimestampMonotonic": "19381625", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-27T14:54:00.066 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Wed 2019-11-27 14:47:36 UTC] ; stop_time=[n/a] ; pid=8967 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-11-27 14:47:36 UTC", "InactiveExitTimestampMonotonic": "19381674", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8967", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-27T14:54:00.067 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-11-27 14:47:36 UTC", "WatchdogTimestampMonotonic": "19381656", "WatchdogUSec": "0"}} 2019-11-27T14:54:00.102 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:00 +0000 (0:00:00.497) 0:06:13.538 **** 2019-11-27T14:54:00.407 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-27T14:54:00.409 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.003942", "end": "2019-11-27 14:54:00.381334", "rc": 0, "start": "2019-11-27 14:54:00.377392", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-27T14:54:00.446 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:00 +0000 (0:00:00.343) 0:06:13.881 **** 2019-11-27T14:54:00.925 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-27T14:54:00.927 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-27T14:54:00.962 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:00 +0000 (0:00:00.515) 0:06:14.397 **** 2019-11-27T14:54:03.389 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-27T14:54:03.425 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:03 +0000 (0:00:02.463) 0:06:16.861 **** 2019-11-27T14:54:04.621 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-27T14:54:04.623 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-27T14:54:04.660 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:04 +0000 (0:00:01.234) 0:06:18.095 **** 2019-11-27T14:54:12.977 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-27T14:54:12.979 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.002656", "end": "2019-11-27 14:54:12.948311", "failed_when_result": false, "rc": 0, "start": "2019-11-27 14:54:04.945655", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-27T14:54:13.013 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:13 +0000 (0:00:08.353) 0:06:26.449 **** 2019-11-27T14:54:13.879 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-27T14:54:13.881 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-27T14:54:13.920 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:13 +0000 (0:00:00.906) 0:06:27.355 **** 2019-11-27T14:54:14.278 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-27T14:54:14.279 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.026654", "end": "2019-11-27 14:54:14.246604", "rc": 0, "start": "2019-11-27 14:54:14.219950", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-27T14:54:14.315 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:14 +0000 (0:00:00.395) 0:06:27.751 **** 2019-11-27T14:54:14.639 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-27T14:54:14.641 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.017024", "end": "2019-11-27 14:54:14.612577", "rc": 0, "start": "2019-11-27 14:54:14.595553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:54:14.676 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:14 +0000 (0:00:00.360) 0:06:28.112 **** 2019-11-27T14:54:22.919 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-27T14:54:22.921 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.917187", "end": "2019-11-27 14:54:22.886171", "rc": 0, "start": "2019-11-27 14:54:14.968984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:54:22.955 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:22 +0000 (0:00:08.278) 0:06:36.390 **** 2019-11-27T14:54:23.267 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-27T14:54:23.269 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-27T14:54:23.304 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.348) 0:06:36.739 **** 2019-11-27T14:54:23.329 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-27T14:54:23.330 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-27T14:54:23.366 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.061) 0:06:36.801 **** 2019-11-27T14:54:23.412 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-27T14:54:23.413 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T14:54:23.448 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.082) 0:06:36.884 **** 2019-11-27T14:54:23.500 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-27T14:54:23.501 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-27T14:54:23.538 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.089) 0:06:36.974 **** 2019-11-27T14:54:23.575 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-27T14:54:23.576 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-27T14:54:23.612 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.074) 0:06:37.048 **** 2019-11-27T14:54:23.927 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-27T14:54:23.929 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-27T14:54:23.965 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:23 +0000 (0:00:00.352) 0:06:37.400 **** 2019-11-27T14:54:24.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-27T14:54:24.284 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-27T14:54:24.319 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:24 +0000 (0:00:00.354) 0:06:37.754 **** 2019-11-27T14:54:24.344 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-27T14:54:24.346 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:54:24.381 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:24 +0000 (0:00:00.062) 0:06:37.817 **** 2019-11-27T14:54:24.407 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-27T14:54:24.408 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:54:24.447 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:24 +0000 (0:00:00.065) 0:06:37.882 **** 2019-11-27T14:54:24.800 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-27T14:54:24.800 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-27T14:54:24.837 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:24 +0000 (0:00:00.390) 0:06:38.272 **** 2019-11-27T14:54:25.828 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-27T14:54:25.829 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-27T14:54:25.865 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:25 +0000 (0:00:01.027) 0:06:39.300 **** 2019-11-27T14:54:25.900 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-27T14:54:25.902 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi156"}, "changed": false} 2019-11-27T14:54:25.940 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:25 +0000 (0:00:00.075) 0:06:39.375 **** 2019-11-27T14:54:26.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-27T14:54:26.492 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi156.front.sepia.ceph.com", "ansible_hostname": "smithi156", "ansible_nodename": "smithi156"}, "changed": true, "name": "smithi156"} 2019-11-27T14:54:26.526 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:26 +0000 (0:00:00.585) 0:06:39.961 **** 2019-11-27T14:54:27.380 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-27T14:54:27.381 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-27T14:54:27.418 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:27 +0000 (0:00:00.892) 0:06:40.854 **** 2019-11-27T14:54:28.279 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-27T14:54:28.280 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-27T14:54:28.320 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:28 +0000 (0:00:00.902) 0:06:41.756 **** 2019-11-27T14:54:29.279 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi156.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-27T14:54:29.315 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:29 +0000 (0:00:00.994) 0:06:42.750 **** 2019-11-27T14:54:29.319 INFO:teuthology.task.ansible.out: 2019-11-27T14:54:30.208 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-27T14:54:30.209 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-27T14:54:30.246 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:30 +0000 (0:00:00.930) 0:06:43.681 **** 2019-11-27T14:54:30.564 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T14:54:30.565 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T14:54:30.602 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:30 +0000 (0:00:00.356) 0:06:44.038 **** 2019-11-27T14:54:30.909 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-27T14:54:30.911 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-27T14:54:30.946 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:30 +0000 (0:00:00.343) 0:06:44.382 **** 2019-11-27T14:54:31.296 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T14:54:31.298 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-27T14:54:31.333 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:31 +0000 (0:00:00.386) 0:06:44.768 **** 2019-11-27T14:54:32.191 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T14:54:32.191 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-27T14:54:32.230 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:32 +0000 (0:00:00.896) 0:06:45.665 **** 2019-11-27T14:54:33.090 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T14:54:33.091 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-27T14:54:33.129 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:33 +0000 (0:00:00.899) 0:06:46.565 **** 2019-11-27T14:54:35.562 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T14:54:35.563 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.121198", "end": "2019-11-27 14:54:35.534548", "rc": 0, "start": "2019-11-27 14:54:33.413350", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:54:35.600 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:35 +0000 (0:00:02.470) 0:06:49.035 **** 2019-11-27T14:54:35.627 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-27T14:54:35.664 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:35 +0000 (0:00:00.064) 0:06:49.100 **** 2019-11-27T14:54:36.591 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-27T14:54:36.591 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-27T14:54:37.428 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-27T14:54:37.467 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:37 +0000 (0:00:01.803) 0:06:50.903 **** 2019-11-27T14:54:37.493 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-27T14:54:37.495 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:54:37.531 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:37 +0000 (0:00:00.063) 0:06:50.967 **** 2019-11-27T14:54:37.567 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-27T14:54:37.568 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:54:37.570 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:54:37.608 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:37 +0000 (0:00:00.076) 0:06:51.043 **** 2019-11-27T14:54:37.634 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-27T14:54:37.635 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:54:37.671 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:37 +0000 (0:00:00.063) 0:06:51.106 **** 2019-11-27T14:54:37.707 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:54:37.709 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-27T14:54:37.745 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:37 +0000 (0:00:00.073) 0:06:51.180 **** 2019-11-27T14:54:38.217 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-27T14:54:38.217 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-27T14:54:38.254 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:38 +0000 (0:00:00.508) 0:06:51.689 **** 2019-11-27T14:54:38.839 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-27T14:54:38.921 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.290812", "end": "2019-11-27 14:54:38.805384", "rc": 0, "start": "2019-11-27 14:54:38.514572", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.math.princeton.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.umd.edu\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.math.princeton.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.jaleco.com", " * updates: mirror.umd.edu", "No unfinished transactions left."]} Wednesday 27 November 2019 14:54:38 +0000 (0:00:00.629) 0:06:52.318 **** 2019-11-27T14:54:39.250 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-27T14:54:39.251 INFO:teuthology.task.ansible.out:fatal: [smithi156.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.054307", "end": "2019-11-27 14:54:39.218863", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 14:54:39.164556", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-27T14:54:39.290 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:39 +0000 (0:00:00.406) 0:06:52.725 **** 2019-11-27T14:54:39.326 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-27T14:54:39.327 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:54:39.364 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:39 +0000 (0:00:00.073) 0:06:52.799 **** 2019-11-27T14:54:50.363 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T14:54:50.364 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-27T14:54:50.366 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-27T14:54:50.367 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T14:54:50.400 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:50 +0000 (0:00:11.036) 0:07:03.835 **** 2019-11-27T14:54:53.810 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-27T14:54:53.850 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:54:53 +0000 (0:00:03.449) 0:07:07.285 **** 2019-11-27T14:55:12.270 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T14:55:12.271 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-27T14:55:12.273 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-27T14:55:12.274 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.math.princeton.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.umd.edu\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\ 2019-11-27T14:55:12.276 INFO:teuthology.task.ansible.out:n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 23 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 7/ 2019-11-27T14:55:12.277 INFO:teuthology.task.ansible.out:8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-27T14:55:12.308 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:12 +0000 (0:00:18.457) 0:07:25.743 **** 2019-11-27T14:55:13.090 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-27T14:55:13.090 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-27T14:55:13.126 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:13 +0000 (0:00:00.818) 0:07:26.562 **** 2019-11-27T14:55:13.658 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T14:55:13.660 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-27T14:55:13.694 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:13 +0000 (0:00:00.567) 0:07:27.130 **** 2019-11-27T14:55:13.732 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:55:13.733 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:13.770 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:13 +0000 (0:00:00.075) 0:07:27.205 **** 2019-11-27T14:55:14.211 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-27T14:55:14.213 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service polkit.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service shutdown.target ipset.service ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-27T14:55:14.214 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-27T14:55:14.216 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T14:55:14.250 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:14 +0000 (0:00:00.480) 0:07:27.686 **** 2019-11-27T14:55:14.629 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-27T14:55:14.631 INFO:teuthology.task.ansible.out:fatal: [smithi156.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-27T14:55:14.668 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:14 +0000 (0:00:00.417) 0:07:28.103 **** 2019-11-27T14:55:15.037 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-27T14:55:15.075 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.407) 0:07:28.511 **** 2019-11-27T14:55:15.102 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-27T14:55:15.104 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.139 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:28.574 **** 2019-11-27T14:55:15.166 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-27T14:55:15.202 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:28.638 **** 2019-11-27T14:55:15.228 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-27T14:55:15.230 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.265 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.062) 0:07:28.701 **** 2019-11-27T14:55:15.293 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-27T14:55:15.294 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.329 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.064) 0:07:28.765 **** 2019-11-27T14:55:15.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-27T14:55:15.368 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi156.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.405 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.075) 0:07:28.840 **** 2019-11-27T14:55:15.431 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-27T14:55:15.433 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.468 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:28.904 **** 2019-11-27T14:55:15.495 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-27T14:55:15.531 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.062) 0:07:28.967 **** 2019-11-27T14:55:15.557 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-27T14:55:15.559 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.595 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:29.030 **** 2019-11-27T14:55:15.621 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-27T14:55:15.624 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.659 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.064) 0:07:29.094 **** 2019-11-27T14:55:15.685 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-27T14:55:15.687 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.724 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.065) 0:07:29.159 **** 2019-11-27T14:55:15.750 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:55:15.752 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.787 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:29.223 **** 2019-11-27T14:55:15.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-27T14:55:15.815 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.850 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.062) 0:07:29.286 **** 2019-11-27T14:55:15.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-27T14:55:15.878 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.912 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.061) 0:07:29.348 **** 2019-11-27T14:55:15.939 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-27T14:55:15.940 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:15.975 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:15 +0000 (0:00:00.063) 0:07:29.411 **** 2019-11-27T14:55:16.002 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-27T14:55:16.003 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.039 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:29.474 **** 2019-11-27T14:55:16.065 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-27T14:55:16.067 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.102 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:29.537 **** 2019-11-27T14:55:16.138 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-27T14:55:16.140 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.180 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.078) 0:07:29.615 **** 2019-11-27T14:55:16.206 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-27T14:55:16.208 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.243 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:29.679 **** 2019-11-27T14:55:16.269 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-27T14:55:16.271 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.307 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:29.742 **** 2019-11-27T14:55:16.332 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-27T14:55:16.334 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.368 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.061) 0:07:29.804 **** 2019-11-27T14:55:16.394 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-27T14:55:16.396 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.431 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.062) 0:07:29.866 **** 2019-11-27T14:55:16.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-27T14:55:16.457 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.492 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.061) 0:07:29.928 **** 2019-11-27T14:55:16.519 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.555 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:29.991 **** 2019-11-27T14:55:16.582 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-27T14:55:16.583 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.619 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:30.054 **** 2019-11-27T14:55:16.645 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-27T14:55:16.646 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.680 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.061) 0:07:30.116 **** 2019-11-27T14:55:16.706 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-27T14:55:16.708 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.744 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:30.180 **** 2019-11-27T14:55:16.770 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-27T14:55:16.772 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.808 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.063) 0:07:30.244 **** 2019-11-27T14:55:16.835 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-27T14:55:16.837 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.874 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.065) 0:07:30.309 **** 2019-11-27T14:55:16.900 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-27T14:55:16.901 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:16.938 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.064) 0:07:30.373 **** 2019-11-27T14:55:16.966 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-27T14:55:16.968 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:17.004 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:16 +0000 (0:00:00.065) 0:07:30.439 **** 2019-11-27T14:55:17.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:17.066 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:17 +0000 (0:00:00.062) 0:07:30.501 **** 2019-11-27T14:55:17.091 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-27T14:55:17.093 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:17.128 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:17 +0000 (0:00:00.062) 0:07:30.563 **** 2019-11-27T14:55:17.154 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T14:55:17.155 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:17.190 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:17 +0000 (0:00:00.061) 0:07:30.625 **** 2019-11-27T14:55:17.514 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T14:55:17.515 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-27T14:55:17.552 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:17 +0000 (0:00:00.361) 0:07:30.987 **** 2019-11-27T14:55:17.881 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T14:55:17.882 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:55:17.918 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:17 +0000 (0:00:00.366) 0:07:31.354 **** 2019-11-27T14:55:18.265 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T14:55:18.266 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-27T14:55:18.302 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.383) 0:07:31.738 **** 2019-11-27T14:55:18.328 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T14:55:18.330 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.365 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.062) 0:07:31.800 **** 2019-11-27T14:55:18.391 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T14:55:18.393 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.428 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.063) 0:07:31.863 **** 2019-11-27T14:55:18.453 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-27T14:55:18.455 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.488 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.060) 0:07:31.924 **** 2019-11-27T14:55:18.514 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T14:55:18.515 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.550 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.061) 0:07:31.985 **** 2019-11-27T14:55:18.575 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T14:55:18.577 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.612 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.062) 0:07:32.047 **** 2019-11-27T14:55:18.638 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T14:55:18.639 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.674 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.061) 0:07:32.109 **** 2019-11-27T14:55:18.699 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-27T14:55:18.701 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.735 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.060) 0:07:32.170 **** 2019-11-27T14:55:18.759 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-27T14:55:18.761 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.794 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.058) 0:07:32.229 **** 2019-11-27T14:55:18.820 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-27T14:55:18.821 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.856 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.062) 0:07:32.291 **** 2019-11-27T14:55:18.892 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-27T14:55:18.893 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.933 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.076) 0:07:32.368 **** 2019-11-27T14:55:18.958 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-27T14:55:18.959 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:18.995 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:18 +0000 (0:00:00.062) 0:07:32.431 **** 2019-11-27T14:55:19.021 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-27T14:55:19.023 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.059 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.063) 0:07:32.494 **** 2019-11-27T14:55:19.085 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-27T14:55:19.087 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.122 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.062) 0:07:32.557 **** 2019-11-27T14:55:19.147 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-27T14:55:19.149 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.184 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.062) 0:07:32.620 **** 2019-11-27T14:55:19.211 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-27T14:55:19.212 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.247 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.062) 0:07:32.682 **** 2019-11-27T14:55:19.272 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-27T14:55:19.273 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.314 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.067) 0:07:32.750 **** 2019-11-27T14:55:19.340 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-27T14:55:19.342 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.377 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.063) 0:07:32.813 **** 2019-11-27T14:55:19.404 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-27T14:55:19.405 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.441 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.063) 0:07:32.876 **** 2019-11-27T14:55:19.466 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-27T14:55:19.468 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.503 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.062) 0:07:32.939 **** 2019-11-27T14:55:19.528 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-27T14:55:19.530 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.565 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.061) 0:07:33.000 **** 2019-11-27T14:55:19.590 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-27T14:55:19.591 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.626 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.061) 0:07:33.062 **** 2019-11-27T14:55:19.654 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-27T14:55:19.655 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.689 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.062) 0:07:33.124 **** 2019-11-27T14:55:19.725 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:55:19.727 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-27T14:55:19.762 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.073) 0:07:33.198 **** 2019-11-27T14:55:19.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-27T14:55:19.799 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.820 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-27T14:55:19.831 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.842 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.853 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.853 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.864 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:19.906 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:19 +0000 (0:00:00.143) 0:07:33.341 **** 2019-11-27T14:55:20.042 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-27T14:55:20.042 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003691", "end": "2019-11-27 14:55:20.025483", "rc": 0, "start": "2019-11-27 14:55:20.021792", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-27T14:55:20.082 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.175) 0:07:33.517 **** 2019-11-27T14:55:20.118 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-27T14:55:20.119 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:20.158 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.076) 0:07:33.594 **** 2019-11-27T14:55:20.185 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-27T14:55:20.186 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:20.221 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.062) 0:07:33.657 **** 2019-11-27T14:55:20.248 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-27T14:55:20.249 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:20.285 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.063) 0:07:33.720 **** 2019-11-27T14:55:20.310 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-27T14:55:20.312 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:20.347 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.062) 0:07:33.782 **** 2019-11-27T14:55:20.845 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-27T14:55:20.847 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-27T14:55:20.885 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.538) 0:07:34.320 **** 2019-11-27T14:55:20.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T14:55:20.923 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item={u'block_used': 13034949, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289535, u'size_available': 930977935360, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289535, "block_size": 4096, "block_total": 240324484, "block_used": 13034949, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977935360, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-27T14:55:20.960 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:20 +0000 (0:00:00.074) 0:07:34.395 **** 2019-11-27T14:55:21.254 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-27T14:55:21.255 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013213", "end": "2019-11-27 14:55:21.234421", "rc": 0, "start": "2019-11-27 14:55:21.221208", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:21.289 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:21 +0000 (0:00:00.328) 0:07:34.724 **** 2019-11-27T14:55:21.323 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-27T14:55:21.324 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'block_used': 13034949, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289535, u'size_available': 930977935360, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289535, "block_size": 4096, "block_total": 240324484, "block_used": 13034949, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977935360, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:21.358 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:21 +0000 (0:00:00.069) 0:07:34.794 **** 2019-11-27T14:55:21.383 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-27T14:55:21.418 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:21 +0000 (0:00:00.059) 0:07:34.854 **** 2019-11-27T14:55:21.464 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-27T14:55:21.465 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTP4', u'wwn-0x5000c5009293f21d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XTP4', u'wwn': u'0x5000c5009293f21d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTP4-part1', u'wwn-0x5000c5009293f21d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTP4", "wwn-0x5000c5009293f21d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTP4-part1", "wwn-0x5000c5009293f21d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTP4", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T14:55:21.467 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009293f21d"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:23.244 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-hedQQW-cRq4-FVxg-ZNq8-erWf-lvwL-LXLwNe', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GU400BGN', u'nvme-nvme.8086-43564654363233333030475534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.481478", "end": "2019-11-27 14:55:23.213123", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-hedQQW-cRq4-FVxg-ZNq8-erWf-lvwL-LXLwNe", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GU400BGN", "nvme-nvme.8086-43564654363233333030475534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:21.731645", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-27T14:55:24.664 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9CSY0h4N26L0CwAEBlkHnWVlRfrwvbFUd'], u'uuids': [u'fc0771ae-4fb2-4f7d-8d2a-9fb6f014181f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065003", "end": "2019-11-27 14:55:24.606539", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9CSY0h4N26L0CwAEBlkHnWVlRfrwvbFUd"], "labels": [], "masters": [], "uuids": ["fc0771ae-4fb2-4f7d-8d2a-9fb6f014181f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:23.541536", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table. 2019-11-27T14:55:24.665 INFO:teuthology.task.ansible.out:", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:55:26.009 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9vza0Ocyg0m9KSl2CH8nZSSGKS7tA16cw'], u'uuids': [u'243d4e01-d784-44e0-ad13-a3dd7f991689']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.056711", "end": "2019-11-27 14:55:25.972937", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9vza0Ocyg0m9KSl2CH8nZSSGKS7tA16cw"], "labels": [], "masters": [], "uuids": ["243d4e01-d784-44e0-ad13-a3dd7f991689"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:24.916226", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:55:27.371 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9EvIHoFgp9lJNWF9ZDuSPcDhcrsowOVGp'], u'uuids': [u'3cd1a72a-00d5-4fb4-9b13-5456076754a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.054185", "end": "2019-11-27 14:55:27.330797", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9EvIHoFgp9lJNWF9ZDuSPcDhcrsowOVGp"], "labels": [], "masters": [], "uuids": ["3cd1a72a-00d5-4fb4-9b13-5456076754a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:26.276612", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:55:28.766 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9Nh0ZP0kj5WHrlSkhY7nkzkVLfzWHbuyz'], u'uuids': [u'659c9e4e-c721-4073-b615-173233d1d3b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.087770", "end": "2019-11-27 14:55:28.731270", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9Nh0ZP0kj5WHrlSkhY7nkzkVLfzWHbuyz"], "labels": [], "masters": [], "uuids": ["659c9e4e-c721-4073-b615-173233d1d3b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:27.643500", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:55:30.138 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9VAfbENvSarcyvRKbCjgzWI5lzawj8Nps'], u'uuids': [u'18a340eb-0eee-427c-afe9-d69c6ad995b7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.048696", "end": "2019-11-27 14:55:30.098315", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9VAfbENvSarcyvRKbCjgzWI5lzawj8Nps"], "labels": [], "masters": [], "uuids": ["18a340eb-0eee-427c-afe9-d69c6ad995b7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:29.049619", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-27T14:55:30.185 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:30 +0000 (0:00:08.766) 0:07:43.621 **** 2019-11-27T14:55:30.236 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-27T14:55:30.237 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTP4', u'wwn-0x5000c5009293f21d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XTP4', u'wwn': u'0x5000c5009293f21d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XTP4-part1', u'wwn-0x5000c5009293f21d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTP4", "wwn-0x5000c5009293f21d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTP4-part1", "wwn-0x5000c5009293f21d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTP4", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-27T14:55:30.239 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009293f21d"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:30.643 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-hedQQW-cRq4-FVxg-ZNq8-erWf-lvwL-LXLwNe', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GU400BGN', u'nvme-nvme.8086-43564654363233333030475534303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.088162", "end": "2019-11-27 14:55:30.602913", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-hedQQW-cRq4-FVxg-ZNq8-erWf-lvwL-LXLwNe", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GU400BGN", "nvme-nvme.8086-43564654363233333030475534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:30.514751", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-27T14:55:30.644 INFO:teuthology.task.ansible.out:pied, 0.0818829 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0818829 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:31.088 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9CSY0h4N26L0CwAEBlkHnWVlRfrwvbFUd'], u'uuids': [u'fc0771ae-4fb2-4f7d-8d2a-9fb6f014181f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.191384", "end": "2019-11-27 14:55:31.052173", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9CSY0h4N26L0CwAEBlkHnWVlRfrwvbFUd"], "labels": [], "masters": [], "uuids": ["fc0771ae-4fb2-4f7d-8d2a-9fb6f014181f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:30.860789", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.184841 s, 624 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.184841 s, 624 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:31.561 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9vza0Ocyg0m9KSl2CH8nZSSGKS7tA16cw'], u'uuids': [u'243d4e01-d784-44e0-ad13-a3dd7f991689']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.188964", "end": "2019-11-27 14:55:31.532623", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9vza0Ocyg0m9KSl2CH8nZSSGKS7tA16cw"], "labels": [], "masters": [], "uuids": ["243d4e01-d784-44e0-ad13-a3dd7f991689"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:31.343659", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.182738 s, 631 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.182738 s, 631 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:32.076 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9EvIHoFgp9lJNWF9ZDuSPcDhcrsowOVGp'], u'uuids': [u'3cd1a72a-00d5-4fb4-9b13-5456076754a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.195052", "end": "2019-11-27 14:55:32.046502", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9EvIHoFgp9lJNWF9ZDuSPcDhcrsowOVGp"], "labels": [], "masters": [], "uuids": ["3cd1a72a-00d5-4fb4-9b13-5456076754a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:31.851450", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.188707 s, 611 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.188707 s, 611 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:32.593 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9Nh0ZP0kj5WHrlSkhY7nkzkVLfzWHbuyz'], u'uuids': [u'659c9e4e-c721-4073-b615-173233d1d3b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.199126", "end": "2019-11-27 14:55:32.556507", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9Nh0ZP0kj5WHrlSkhY7nkzkVLfzWHbuyz"], "labels": [], "masters": [], "uuids": ["659c9e4e-c721-4073-b615-173233d1d3b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:32.357381", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.192345 s, 600 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.192345 s, 600 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:33.104 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9VAfbENvSarcyvRKbCjgzWI5lzawj8Nps'], u'uuids': [u'18a340eb-0eee-427c-afe9-d69c6ad995b7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.200144", "end": "2019-11-27 14:55:33.069348", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XdbJdjgqk5oD6mP2SkoD0M9KeXA5wFZ9VAfbENvSarcyvRKbCjgzWI5lzawj8Nps"], "labels": [], "masters": [], "uuids": ["18a340eb-0eee-427c-afe9-d69c6ad995b7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-27 14:55:32.869204", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19329 s, 597 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19329 s, 597 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:33.148 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:33 +0000 (0:00:02.962) 0:07:46.584 **** 2019-11-27T14:55:33.537 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-27T14:55:33.538 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.083319", "end": "2019-11-27 14:55:33.506678", "rc": 0, "start": "2019-11-27 14:55:33.423359", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:33.573 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:33 +0000 (0:00:00.425) 0:07:47.009 **** 2019-11-27T14:55:33.930 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-27T14:55:33.931 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053985", "end": "2019-11-27 14:55:33.906098", "rc": 0, "start": "2019-11-27 14:55:33.852113", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:33.968 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:33 +0000 (0:00:00.394) 0:07:47.404 **** 2019-11-27T14:55:33.995 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-27T14:55:34.035 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.066) 0:07:47.470 **** 2019-11-27T14:55:34.061 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-27T14:55:34.062 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.103 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.067) 0:07:47.538 **** 2019-11-27T14:55:34.129 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-27T14:55:34.131 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.166 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.063) 0:07:47.602 **** 2019-11-27T14:55:34.192 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-27T14:55:34.194 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.232 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.065) 0:07:47.667 **** 2019-11-27T14:55:34.258 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-27T14:55:34.260 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.295 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.063) 0:07:47.730 **** 2019-11-27T14:55:34.621 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-27T14:55:34.621 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-27T14:55:34.660 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.364) 0:07:48.095 **** 2019-11-27T14:55:34.697 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-27T14:55:34.698 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={u'block_used': 13034949, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289535, u'size_available': 930977935360, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966951, u'device': u'/dev/sda1', u'inode_used': 88025, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289535, "block_size": 4096, "block_total": 240324484, "block_used": 13034949, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966951, "inode_total": 61054976, "inode_used": 88025, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977935360, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.736 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.076) 0:07:48.171 **** 2019-11-27T14:55:34.762 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-27T14:55:34.764 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.799 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.063) 0:07:48.235 **** 2019-11-27T14:55:34.826 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:55:34.828 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.863 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.063) 0:07:48.298 **** 2019-11-27T14:55:34.890 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:55:34.891 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.928 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.064) 0:07:48.363 **** 2019-11-27T14:55:34.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-27T14:55:34.956 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:34.991 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:34 +0000 (0:00:00.063) 0:07:48.427 **** 2019-11-27T14:55:35.018 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-27T14:55:35.019 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:35.054 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:35 +0000 (0:00:00.062) 0:07:48.490 **** 2019-11-27T14:55:35.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-27T14:55:35.094 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:35.129 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:35 +0000 (0:00:00.074) 0:07:48.564 **** 2019-11-27T14:55:35.665 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-27T14:55:35.667 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-27T14:55:35.708 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:35 +0000 (0:00:00.572) 0:07:49.137 **** 2019-11-27T14:55:36.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-27T14:55:36.255 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:55:36.741 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:55:37.203 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:55:37.684 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:55:38.175 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-27T14:55:38.212 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:38 +0000 (0:00:02.510) 0:07:51.648 **** 2019-11-27T14:55:38.523 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-27T14:55:38.561 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:38 +0000 (0:00:00.348) 0:07:51.997 **** 2019-11-27T14:55:38.610 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-27T14:55:38.611 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:38.927 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:55:39.250 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:55:39.542 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:55:39.835 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-27T14:55:39.873 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:39 +0000 (0:00:01.312) 0:07:53.309 **** 2019-11-27T14:55:40.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-27T14:55:40.199 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-27T14:55:40.238 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:40 +0000 (0:00:00.364) 0:07:53.673 **** 2019-11-27T14:55:40.277 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-27T14:55:40.278 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-27T14:55:40.316 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:40 +0000 (0:00:00.078) 0:07:53.751 **** 2019-11-27T14:55:40.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi156.front.sepia.ceph.com] => {"changed": true} 2019-11-27T14:55:40.791 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:40 +0000 (0:00:00.475) 0:07:54.227 **** 2019-11-27T14:55:41.244 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-27T14:55:41.280 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.488) 0:07:54.715 **** 2019-11-27T14:55:41.319 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-27T14:55:41.320 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.358 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.077) 0:07:54.793 **** 2019-11-27T14:55:41.394 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-27T14:55:41.395 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.431 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.073) 0:07:54.866 **** 2019-11-27T14:55:41.458 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-27T14:55:41.459 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.497 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.065) 0:07:54.932 **** 2019-11-27T14:55:41.523 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-27T14:55:41.524 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.564 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.066) 0:07:54.999 **** 2019-11-27T14:55:41.590 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-27T14:55:41.591 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.629 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.065) 0:07:55.065 **** 2019-11-27T14:55:41.654 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-27T14:55:41.655 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.692 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.062) 0:07:55.128 **** 2019-11-27T14:55:41.718 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-27T14:55:41.718 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:41.756 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:41 +0000 (0:00:00.063) 0:07:55.191 **** 2019-11-27T14:55:42.235 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-27T14:55:42.272 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:42 +0000 (0:00:00.515) 0:07:55.707 **** 2019-11-27T14:55:42.298 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-27T14:55:42.299 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:42.338 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:42 +0000 (0:00:00.065) 0:07:55.773 **** 2019-11-27T14:55:42.365 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-27T14:55:42.366 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:42.403 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:42 +0000 (0:00:00.064) 0:07:55.838 **** 2019-11-27T14:55:43.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-27T14:55:43.375 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:43 +0000 (0:00:00.972) 0:07:56.810 **** 2019-11-27T14:55:43.403 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-27T14:55:43.404 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:43.444 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:43 +0000 (0:00:00.069) 0:07:56.880 **** 2019-11-27T14:55:43.960 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-27T14:55:43.962 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket syslog.target sntp.service basic.target ntpdate.service tmp.mount system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-27T14:55:43.963 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-27T14:55:43.965 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-27T14:55:44.000 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:43 +0000 (0:00:00.555) 0:07:57.435 **** 2019-11-27T14:55:44.945 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-27T14:55:44.984 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:44 +0000 (0:00:00.983) 0:07:58.419 **** 2019-11-27T14:55:45.011 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-27T14:55:45.012 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:45.050 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:45 +0000 (0:00:00.066) 0:07:58.486 **** 2019-11-27T14:55:45.378 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-27T14:55:45.379 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-27T14:55:45.418 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:45 +0000 (0:00:00.367) 0:07:58.853 **** 2019-11-27T14:55:46.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-27T14:55:46.335 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-27T14:55:46.371 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:46 +0000 (0:00:00.953) 0:07:59.807 **** 2019-11-27T14:55:47.858 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-27T14:55:47.859 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-27T14:55:47.896 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:47 +0000 (0:00:01.525) 0:08:01.332 **** 2019-11-27T14:55:47.922 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-27T14:55:47.924 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:47.959 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:47 +0000 (0:00:00.062) 0:08:01.394 **** 2019-11-27T14:55:47.984 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-27T14:55:47.986 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-27T14:55:48.020 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.061) 0:08:01.456 **** 2019-11-27T14:55:48.324 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-27T14:55:48.326 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-27T14:55:48.359 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.338) 0:08:01.795 **** 2019-11-27T14:55:48.385 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-27T14:55:48.387 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:48.422 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.062) 0:08:01.857 **** 2019-11-27T14:55:48.447 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-27T14:55:48.448 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-27T14:55:48.483 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.061) 0:08:01.918 **** 2019-11-27T14:55:48.509 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-27T14:55:48.510 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:48.544 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.061) 0:08:01.980 **** 2019-11-27T14:55:48.868 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-27T14:55:48.870 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-27T14:55:48.904 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:48 +0000 (0:00:00.359) 0:08:02.340 **** 2019-11-27T14:55:49.228 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-27T14:55:49.229 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-27T14:55:49.263 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.358) 0:08:02.698 **** 2019-11-27T14:55:49.288 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-27T14:55:49.289 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.322 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.059) 0:08:02.758 **** 2019-11-27T14:55:49.358 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-27T14:55:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi156.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.370 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.370 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.381 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.415 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.093) 0:08:02.851 **** 2019-11-27T14:55:49.451 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-27T14:55:49.452 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.462 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.463 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.474 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.474 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.510 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.094) 0:08:02.945 **** 2019-11-27T14:55:49.545 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-27T14:55:49.551 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.584 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.074) 0:08:03.020 **** 2019-11-27T14:55:49.609 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-27T14:55:49.611 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.643 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.058) 0:08:03.078 **** 2019-11-27T14:55:49.667 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-27T14:55:49.669 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.704 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.060) 0:08:03.139 **** 2019-11-27T14:55:49.729 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-27T14:55:49.730 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.762 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.058) 0:08:03.198 **** 2019-11-27T14:55:49.787 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-27T14:55:49.788 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.824 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.061) 0:08:03.259 **** 2019-11-27T14:55:49.849 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T14:55:49.851 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.886 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.062) 0:08:03.321 **** 2019-11-27T14:55:49.911 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-27T14:55:49.912 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:49.948 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:49 +0000 (0:00:00.061) 0:08:03.383 **** 2019-11-27T14:55:49.973 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-27T14:55:49.974 INFO:teuthology.task.ansible.out:skipping: [smithi156.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-27T14:55:50.007 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:50 +0000 (0:00:00.059) 0:08:03.443 **** 2019-11-27T14:55:50.330 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-27T14:55:50.331 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012779", "end": "2019-11-27 14:55:50.291832", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-27 14:55:50.279053", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:50.629 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007261", "end": "2019-11-27 14:55:50.596119", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-27 14:55:50.588858", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:50.897 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005389", "end": "2019-11-27 14:55:50.862270", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-27 14:55:50.856881", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:51.239 INFO:teuthology.task.ansible.out:ok: [smithi156.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037321", "end": "2019-11-27 14:55:51.204312", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-27 14:55:51.166991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-27T14:55:51.276 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:51 +0000 (0:00:01.269) 0:08:04.712 **** 2019-11-27T14:55:51.302 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-27T14:55:51.338 INFO:teuthology.task.ansible.out:Wednesday 27 November 2019 14:55:51 +0000 (0:00:00.061) 0:08:04.773 **** 2019-11-27T14:55:51.659 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-27T14:55:51.660 INFO:teuthology.task.ansible.out:changed: [smithi156.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-27T14:55:51.755 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-11-27T14:55:51.757 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-27T14:55:51.759 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2019-11-27T14:55:51.761 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi003.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi156.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 Wednesday 27 November 2019 14:55:51 +0000 (0:00:00.421) 0:08:05.195 **** =============================================================================== users : Create all admin users with sudo access. ----------------------- 38.80s users : Update authorized_keys using the keys repo --------------------- 37.83s testnode : Install packages -------------------------------------------- 18.46s common : Update yum cache ---------------------------------------------- 15.29s testnode : Ensure ceph packages are not present. ----------------------- 11.04s 2019-11-27T14:55:51.762 INFO:teuthology.task.ansible.out:testnode : Zap all non-root disks --------------------------------------- 8.77s common : nrpe - Remove SELinux policy package --------------------------- 8.35s common : nrpe - Load SELinux policy package ----------------------------- 8.28s users : Remove revoked users -------------------------------------------- 7.39s common : Make sure smartmontools is installed --------------------------- 3.98s testnode : Ensure ceph dependency packages are not present. ------------- 3.45s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 3.39s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.96s Gathering Facts --------------------------------------------------------- 2.78s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.69s ansible-managed : Add authorized keys for the ansible user. ------------- 2.68s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 2.56s testnode : Create logical volume(s) ------------------------------------- 2.51s testnode : Rebuild rpmdb ------------------------------------------------ 2.47s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.46s 2019-11-27T14:55:52.014 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi003.front.sepia.ceph.com')] 2019-11-27T14:55:52.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:55:52.017 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:55:52.117 INFO:teuthology.orchestra.run.smithi156:> true 2019-11-27T14:55:52.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-27T14:55:52.504 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi003.front.sepia.ceph.com', 'timeout': 60} 2019-11-27T14:55:52.604 INFO:teuthology.orchestra.run.smithi003:> true 2019-11-27T14:55:53.028 INFO:teuthology.run_tasks:Running task clock... 2019-11-27T14:55:53.039 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-27T14:55:53.040 INFO:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-27T14:55:53.182 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-27T14:56:03.275 INFO:teuthology.orchestra.run.smithi156.stdout:ntpd: time slew -0.000676s 2019-11-27T14:56:03.315 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit not found. 2019-11-27T14:56:03.398 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2019-11-27T14:56:03.398 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2019-11-27T14:56:03.398 INFO:teuthology.orchestra.run.smithi156.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:03.399 INFO:teuthology.orchestra.run.smithi156.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:03.399 INFO:teuthology.orchestra.run.smithi156.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:03.399 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:03.400 INFO:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-27T14:56:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-27T14:56:13.625 INFO:teuthology.orchestra.run.smithi003.stdout:ntpd: time slew -0.000893s 2019-11-27T14:56:13.663 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit not found. 2019-11-27T14:56:13.741 INFO:teuthology.orchestra.run.smithi003.stdout: remote refid st t when poll reach delay offset jitter 2019-11-27T14:56:13.741 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================== 2019-11-27T14:56:13.741 INFO:teuthology.orchestra.run.smithi003.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:13.742 INFO:teuthology.orchestra.run.smithi003.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:13.742 INFO:teuthology.orchestra.run.smithi003.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:13.742 INFO:teuthology.orchestra.run.smithi003.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-27T14:56:13.743 INFO:teuthology.run_tasks:Running task install... 2019-11-27T14:56:15.336 DEBUG:teuthology.task.install:project ceph 2019-11-27T14:56:15.336 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}} 2019-11-27T14:56:15.336 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'} 2019-11-27T14:56:15.336 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-27T14:56:15.341 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-27T14:56:15.342 INFO:teuthology.task.install:extra packages: [] 2019-11-27T14:56:15.342 INFO:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2019-11-27T14:56:15.505 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS 2019-11-27T14:56:15.507 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:56:15.507 INFO:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2019-11-27T14:56:15.508 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-27T14:56:15.508 INFO:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2019-11-27T14:56:15.622 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS 2019-11-27T14:56:15.623 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:56:15.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T14:56:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2019-11-27T14:56:15.674 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:56:15.675 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-27T14:56:15.675 INFO:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2019-11-27T14:56:15.774 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-27T14:56:15.774 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-27T14:56:15.807 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2019-11-27T14:56:15.810 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:56:15.811 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T14:56:15.886 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-27T14:56:15.972 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-27T14:56:15.972 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-27T14:56:16.009 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-27T14:56:16.009 INFO:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-27T14:56:16.086 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-27T14:56:16.118 INFO:teuthology.orchestra.run.smithi156:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-27T14:56:16.201 INFO:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-27T14:56:16.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-27T14:56:16.208 INFO:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-27T14:56:16.277 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2019-11-27T14:56:16.279 INFO:teuthology.orchestra.run.smithi156:> sudo yum clean all 2019-11-27T14:56:16.324 INFO:teuthology.orchestra.run.smithi003:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-27T14:56:16.432 INFO:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-27T14:56:16.440 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:16.478 INFO:teuthology.orchestra.run.smithi156.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-27T14:56:16.478 INFO:teuthology.orchestra.run.smithi156.stdout: : lab-extras updates 2019-11-27T14:56:16.522 INFO:teuthology.orchestra.run.smithi156.stdout:Cleaning up list of fastest mirrors 2019-11-27T14:56:16.523 INFO:teuthology.orchestra.run.smithi156.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-27T14:56:16.536 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw 2019-11-27T14:56:16.544 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2019-11-27T14:56:16.546 INFO:teuthology.orchestra.run.smithi003:> sudo yum clean all 2019-11-27T14:56:16.714 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:16.752 INFO:teuthology.orchestra.run.smithi156.stdout:Determining fastest mirrors 2019-11-27T14:56:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-27T14:56:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: : lab-extras updates 2019-11-27T14:56:16.895 INFO:teuthology.orchestra.run.smithi003.stdout:Cleaning up list of fastest mirrors 2019-11-27T14:56:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-27T14:56:16.910 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2019-11-27T14:56:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:17.185 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:56:17.185 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:56:17.185 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:56:17.186 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:56:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:Determining fastest mirrors 2019-11-27T14:56:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:56:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:56:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:56:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:56:25.661 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:56:25.932 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:56:26.014 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:56:26.014 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:26.015 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.027 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.138 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.139 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.140 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.141 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.142 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.144 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.144 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.146 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.147 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:26.147 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.155 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.156 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.157 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.159 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.160 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.161 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.163 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-27T14:56:26.164 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-27T14:56:26.164 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T14:56:26.165 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T14:56:26.166 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-27T14:56:26.167 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.168 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:26.169 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.173 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.174 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.175 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.176 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.177 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.178 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.178 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.179 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.180 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.180 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.182 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.182 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-27T14:56:26.182 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.183 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T14:56:26.183 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T14:56:26.183 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-27T14:56:26.184 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T14:56:26.185 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T14:56:26.185 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:26.186 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-27T14:56:26.187 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.188 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.188 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.188 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.189 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-27T14:56:26.189 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.190 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.190 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.190 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-27T14:56:26.294 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:56:26.294 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:56:26.294 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.307 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.422 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.423 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.424 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.426 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.427 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.428 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.429 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.430 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.432 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:56:26.432 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.440 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.442 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.443 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.445 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.446 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.447 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.449 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-27T14:56:26.450 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-27T14:56:26.450 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T14:56:26.451 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T14:56:26.453 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-27T14:56:26.454 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.455 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:56:26.455 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.459 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.461 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.462 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.462 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.464 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.465 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.465 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.466 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.467 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.468 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.469 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:26.469 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-27T14:56:26.469 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.470 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-27T14:56:26.470 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-27T14:56:26.471 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-27T14:56:26.471 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T14:56:26.473 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-27T14:56:26.473 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:56:26.473 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-27T14:56:26.474 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.475 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.475 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.475 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.477 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-27T14:56:26.477 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.477 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.478 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:26.478 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-27T14:56:27.057 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:56:27.143 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:27.143 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:56:27.146 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:27.146 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:56:27.147 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-27T14:56:27.148 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-27T14:56:27.149 INFO:teuthology.orchestra.run.smithi156.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout:Updating for dependencies: 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-27T14:56:27.150 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+20 Dependent packages) 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade ( 2 Dependent packages) 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:27.151 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 45 M 2019-11-27T14:56:27.152 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:56:27.152 INFO:teuthology.orchestra.run.smithi156.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T14:56:27.381 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:56:27.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:27.469 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:56:27.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:27.473 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:56:27.473 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:56:27.473 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-27T14:56:27.474 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-27T14:56:27.475 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-27T14:56:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout:Updating for dependencies: 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:27.477 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+20 Dependent packages) 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade ( 2 Dependent packages) 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 45 M 2019-11-27T14:56:27.478 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:56:27.479 INFO:teuthology.orchestra.run.smithi003.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-27T14:56:31.767 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:56:31.767 INFO:teuthology.orchestra.run.smithi156.stdout:Total 9.6 MB/s | 45 MB 00:04 2019-11-27T14:56:31.782 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:56:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:56:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:56:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:56:32.674 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:56:32.675 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.6 MB/s | 45 MB 00:05 2019-11-27T14:56:32.693 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:56:32.770 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:56:32.857 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T14:56:32.998 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:56:32.998 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:56:33.227 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-27T14:56:33.545 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-27T14:56:33.713 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T14:56:33.835 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T14:56:34.090 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-27T14:56:34.178 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-27T14:56:34.399 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-27T14:56:34.511 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-27T14:56:34.665 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T14:56:34.863 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-27T14:56:34.933 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-27T14:56:35.140 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T14:56:35.257 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-27T14:56:35.502 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-27T14:56:35.603 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-27T14:56:35.920 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T14:56:36.286 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-27T14:56:36.311 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-27T14:56:36.681 INFO:teuthology.orchestra.run.smithi156.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-27T14:56:37.052 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-27T14:56:37.445 INFO:teuthology.orchestra.run.smithi003.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-27T14:56:37.543 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T14:56:37.936 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-27T14:56:38.288 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T14:56:38.497 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T14:56:38.633 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-27T14:56:38.814 INFO:teuthology.orchestra.run.smithi156.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T14:56:39.094 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-27T14:56:39.170 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T14:56:39.361 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T14:56:39.511 INFO:teuthology.orchestra.run.smithi003.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T14:56:39.712 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T14:56:39.924 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-27T14:56:40.183 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T14:56:40.480 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T14:56:42.168 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T14:56:42.988 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T14:56:43.287 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T14:56:43.813 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T14:56:44.153 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T14:56:44.688 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T14:56:53.196 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T14:56:53.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-27T14:56:53.811 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T14:56:54.105 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T14:56:54.209 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T14:56:54.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-27T14:56:54.485 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-27T14:56:54.577 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T14:56:54.865 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T14:56:55.239 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-27T14:56:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-27T14:56:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T14:56:55.528 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-27T14:56:55.645 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-27T14:56:55.771 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T14:56:55.809 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T14:56:55.921 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-27T14:56:55.953 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-27T14:56:56.055 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-27T14:56:56.062 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-27T14:56:56.163 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-27T14:56:56.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-27T14:56:56.238 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-27T14:56:56.290 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T14:56:56.347 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-27T14:56:56.382 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-27T14:56:56.439 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-27T14:56:56.499 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T14:56:56.633 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T14:56:56.733 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-27T14:56:56.876 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T14:56:57.010 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T14:56:57.110 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T14:56:57.223 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-27T14:56:57.227 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T14:56:57.324 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-27T14:56:57.353 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T14:56:57.433 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-27T14:56:57.462 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T14:56:57.566 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-27T14:56:57.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-27T14:56:57.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T14:56:57.675 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-27T14:56:57.776 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-27T14:56:57.887 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:57.986 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.987 INFO:teuthology.orchestra.run.smithi156.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.988 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-27T14:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:57.990 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Updated: 2019-11-27T14:56:57.990 INFO:teuthology.orchestra.run.smithi156.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.990 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:57.990 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:56:57.990 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:56:58.010 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-27T14:56:58.104 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-test 2019-11-27T14:56:58.136 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-27T14:56:58.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-27T14:56:58.361 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:58.387 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-27T14:56:58.400 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:56:58.401 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:56:58.401 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:56:58.402 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:56:58.402 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:56:58.471 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-27T14:56:58.571 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-27T14:56:58.672 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-27T14:56:58.747 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-27T14:56:58.831 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-27T14:56:58.940 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-27T14:56:58.942 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-27T14:56:59.045 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:56:59.323 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-27T14:56:59.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.324 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-27T14:56:59.325 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.326 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-27T14:56:59.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:59.328 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Updated: 2019-11-27T14:56:59.328 INFO:teuthology.orchestra.run.smithi003.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.328 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:56:59.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:56:59.328 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:56:59.373 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:56:59.373 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:59.373 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:56:59.391 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:59.420 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:59.421 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:56:59.422 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:59.422 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-27T14:56:59.423 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-27T14:56:59.424 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-27T14:56:59.426 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-27T14:56:59.428 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:56:59.428 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-27T14:56:59.461 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2019-11-27T14:56:59.749 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:56:59.788 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:56:59.795 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:56:59.796 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:56:59.796 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:56:59.797 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:56:59.797 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:00.012 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:00.013 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:00.014 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:00.014 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:00.014 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:57:00.014 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:57:00.014 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:00.015 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:00.015 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-27T14:57:00.015 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:57:00.015 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-27T14:57:00.015 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:00.016 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:57:00.017 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:00.017 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 38 M 2019-11-27T14:57:00.017 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 134 M 2019-11-27T14:57:00.017 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:00.457 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:00.818 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:57:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:00.819 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:00.838 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:00.868 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:00.869 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:00.870 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-27T14:57:00.871 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-27T14:57:00.872 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-27T14:57:00.874 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-27T14:57:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:00.877 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-27T14:57:01.260 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:01.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:01.488 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:57:01.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:01.489 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:01.489 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:57:01.490 INFO:teuthology.orchestra.run.smithi003.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:57:01.491 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:01.492 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:57:01.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:01.492 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 38 M 2019-11-27T14:57:01.492 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 134 M 2019-11-27T14:57:01.492 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:57:01.845 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:01.845 INFO:teuthology.orchestra.run.smithi156.stdout:Total 21 MB/s | 38 MB 00:01 2019-11-27T14:57:01.848 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:01.868 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:02.631 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-27T14:57:02.934 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T14:57:03.279 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-27T14:57:03.352 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:03.353 INFO:teuthology.orchestra.run.smithi003.stdout:Total 21 MB/s | 38 MB 00:01 2019-11-27T14:57:03.356 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:57:03.378 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:57:03.464 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:57:03.465 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:57:04.178 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-27T14:57:04.481 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T14:57:04.809 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-27T14:57:07.316 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-27T14:57:07.615 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:57:07.737 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-27T14:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T14:57:07.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-27T14:57:08.072 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-27T14:57:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-27T14:57:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:08.524 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-27T14:57:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:08.526 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:57:08.655 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph 2019-11-27T14:57:08.920 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:08.965 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:08.966 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:08.966 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:08.966 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:08.967 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:09.080 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-27T14:57:09.375 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:57:09.498 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-27T14:57:09.616 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:09.624 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-27T14:57:09.774 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-27T14:57:09.883 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-27T14:57:09.966 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:57:09.966 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:09.966 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:09.968 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:09.998 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:09.999 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.000 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.001 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.001 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:10.012 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:10.014 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.015 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.016 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.017 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.018 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.019 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:10.020 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:10.023 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:10.027 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.027 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-27T14:57:10.028 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-27T14:57:10.029 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-27T14:57:10.029 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:10.030 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:10.031 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:10.032 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:10.033 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:10.034 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-27T14:57:10.034 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-27T14:57:10.035 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-27T14:57:10.035 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-27T14:57:10.036 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-27T14:57:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-27T14:57:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T14:57:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T14:57:10.038 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-27T14:57:10.039 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-27T14:57:10.039 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-27T14:57:10.040 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-27T14:57:10.041 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-27T14:57:10.041 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.041 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-27T14:57:10.041 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-27T14:57:10.042 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:10.042 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-27T14:57:10.401 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-27T14:57:10.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:10.402 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:57:10.402 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:10.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:10.402 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:57:10.403 INFO:teuthology.orchestra.run.smithi003.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-27T14:57:10.403 INFO:teuthology.orchestra.run.smithi003.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-27T14:57:10.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:10.403 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:57:10.404 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:10.518 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2019-11-27T14:57:10.628 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:10.628 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:10.631 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:10.631 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:10.631 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-27T14:57:10.632 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-27T14:57:10.633 INFO:teuthology.orchestra.run.smithi156.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-27T14:57:10.634 INFO:teuthology.orchestra.run.smithi156.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:10.635 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:10.636 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+21 Dependent packages) 2019-11-27T14:57:10.636 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:10.636 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 28 M 2019-11-27T14:57:10.637 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 87 M 2019-11-27T14:57:10.637 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:10.803 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:10.850 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:10.851 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:10.852 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:10.852 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:10.853 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:11.516 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:11.868 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:57:11.869 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.869 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:11.871 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.901 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.902 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.904 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.905 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.905 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:11.916 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:11.918 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.919 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.921 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.922 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.923 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.924 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:57:11.925 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:11.928 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:11.933 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.933 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-27T14:57:11.934 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-27T14:57:11.935 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-27T14:57:11.935 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:11.936 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:11.937 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:11.938 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:11.939 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-27T14:57:11.940 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-27T14:57:11.940 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-27T14:57:11.941 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-27T14:57:11.942 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-27T14:57:11.942 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-27T14:57:11.943 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.943 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-27T14:57:11.943 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T14:57:11.944 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-27T14:57:11.945 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-27T14:57:11.945 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-27T14:57:11.945 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-27T14:57:11.946 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-27T14:57:11.946 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-27T14:57:11.947 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-27T14:57:11.947 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.947 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-27T14:57:11.947 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-27T14:57:11.948 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-27T14:57:11.948 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.948 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-27T14:57:11.948 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-27T14:57:11.949 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:11.949 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-27T14:57:12.328 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:12.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:12.562 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:57:12.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:12.565 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:12.565 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-27T14:57:12.566 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-27T14:57:12.567 INFO:teuthology.orchestra.run.smithi003.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-27T14:57:12.568 INFO:teuthology.orchestra.run.smithi003.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:12.569 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:57:12.570 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:12.570 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+21 Dependent packages) 2019-11-27T14:57:12.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:12.570 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 28 M 2019-11-27T14:57:12.571 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 87 M 2019-11-27T14:57:12.571 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:57:12.643 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:12.643 INFO:teuthology.orchestra.run.smithi156.stdout:Total 14 MB/s | 28 MB 00:02 2019-11-27T14:57:12.667 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:12.712 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:12.993 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:12.993 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:13.798 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-27T14:57:14.140 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-27T14:57:14.918 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-27T14:57:16.010 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:Total 7.8 MB/s | 28 MB 00:03 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:57:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:57:17.184 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-27T14:57:17.184 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-27T14:57:17.324 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-27T14:57:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-27T14:57:17.835 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-27T14:57:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-27T14:57:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-27T14:57:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-27T14:57:19.688 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-27T14:57:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-27T14:57:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-27T14:57:20.340 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-27T14:57:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-27T14:57:20.740 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-27T14:57:21.092 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-27T14:57:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-27T14:57:21.652 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-27T14:57:22.056 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T14:57:22.403 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-27T14:57:22.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-27T14:57:22.911 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-27T14:57:23.083 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-27T14:57:23.227 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-27T14:57:23.495 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-27T14:57:23.654 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-27T14:57:23.893 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-27T14:57:24.195 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-27T14:57:24.339 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-27T14:57:24.748 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T14:57:24.778 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-27T14:57:25.044 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-27T14:57:25.226 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T14:57:25.398 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-27T14:57:25.515 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-27T14:57:25.589 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-27T14:57:25.649 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-27T14:57:25.791 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-27T14:57:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-27T14:57:25.916 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-27T14:57:26.033 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-27T14:57:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-27T14:57:26.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-27T14:57:26.301 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-27T14:57:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-27T14:57:26.402 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-27T14:57:26.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-27T14:57:26.653 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-27T14:57:26.736 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-27T14:57:26.835 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-27T14:57:26.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-27T14:57:26.962 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T14:57:27.088 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-27T14:57:27.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-27T14:57:27.322 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-27T14:57:27.423 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-27T14:57:27.548 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-27T14:57:27.699 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-27T14:57:27.825 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T14:57:27.843 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-27T14:57:28.284 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T14:57:28.329 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-27T14:57:28.329 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:28.329 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:57:28.329 INFO:teuthology.orchestra.run.smithi156.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:28.329 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-27T14:57:28.330 INFO:teuthology.orchestra.run.smithi156.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-27T14:57:28.331 INFO:teuthology.orchestra.run.smithi156.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-27T14:57:28.332 INFO:teuthology.orchestra.run.smithi156.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-27T14:57:28.332 INFO:teuthology.orchestra.run.smithi156.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-27T14:57:28.332 INFO:teuthology.orchestra.run.smithi156.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-27T14:57:28.332 INFO:teuthology.orchestra.run.smithi156.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-27T14:57:28.333 INFO:teuthology.orchestra.run.smithi156.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-27T14:57:28.333 INFO:teuthology.orchestra.run.smithi156.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-27T14:57:28.333 INFO:teuthology.orchestra.run.smithi156.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-27T14:57:28.333 INFO:teuthology.orchestra.run.smithi156.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-27T14:57:28.334 INFO:teuthology.orchestra.run.smithi156.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-27T14:57:28.335 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:28.335 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:57:28.460 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-daemon 2019-11-27T14:57:28.549 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-27T14:57:28.641 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-27T14:57:28.745 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:28.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-27T14:57:28.786 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:28.787 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:28.787 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:28.787 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:28.788 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:28.859 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-27T14:57:28.934 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-27T14:57:29.026 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-27T14:57:29.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-27T14:57:29.219 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-27T14:57:29.328 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-27T14:57:29.434 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:29.470 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-27T14:57:29.587 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-27T14:57:29.704 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-27T14:57:29.769 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:57:29.770 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:29.770 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:29.804 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-27T14:57:29.930 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-27T14:57:30.030 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-27T14:57:30.136 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:30.189 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-27T14:57:30.314 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-27T14:57:30.364 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:30.365 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:30.365 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:30.365 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:30.366 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 17 k 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 67 k 2019-11-27T14:57:30.367 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:30.415 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-27T14:57:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-27T14:57:30.616 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-27T14:57:30.656 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:30.662 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:30.663 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:30.664 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:30.716 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-27T14:57:30.808 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-27T14:57:31.254 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-27T14:57:31.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.255 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-27T14:57:31.256 INFO:teuthology.orchestra.run.smithi003.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-27T14:57:31.257 INFO:teuthology.orchestra.run.smithi003.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-27T14:57:31.258 INFO:teuthology.orchestra.run.smithi003.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-27T14:57:31.258 INFO:teuthology.orchestra.run.smithi003.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-27T14:57:31.258 INFO:teuthology.orchestra.run.smithi003.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-27T14:57:31.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:31.258 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:57:31.389 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-daemon 2019-11-27T14:57:31.467 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:57:31.674 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:31.720 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:31.721 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:31.721 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:31.722 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:31.722 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:31.957 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:57:31.957 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:57:31.958 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:31.958 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:57:32.074 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr 2019-11-27T14:57:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:32.379 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:32.394 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:32.396 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:32.396 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:32.396 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:32.397 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:32.738 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:57:32.739 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:32.739 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:33.127 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:33.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:33.360 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:57:33.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:33.361 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:33.362 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 17 k 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 67 k 2019-11-27T14:57:33.363 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:57:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:57:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do 2019-11-27T14:57:33.460 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-dashboard 2019-11-27T14:57:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:33.660 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:33.661 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:33.661 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:33.661 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:33.837 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:57:33.845 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:57:33.846 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:57:33.847 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:57:34.247 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:34.573 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:57:34.574 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:34.574 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:34.577 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:57:34.606 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:57:34.608 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:34.608 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:34.608 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-27T14:57:34.608 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-27T14:57:34.609 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:34.609 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-27T14:57:34.642 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:57:34.977 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:35.066 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:57:35.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:35.066 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:57:35.067 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:35.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:35.067 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:57:35.199 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2019-11-27T14:57:35.207 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:35.207 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:35.208 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:35.208 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-27T14:57:35.209 INFO:teuthology.orchestra.run.smithi156.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+3 Dependent packages) 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:35.210 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 4.5 M 2019-11-27T14:57:35.211 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 20 M 2019-11-27T14:57:35.211 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:35.450 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:35.496 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:35.497 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:35.498 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:35.498 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:35.498 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:36.183 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:36.541 INFO:teuthology.orchestra.run.smithi003.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:57:36.541 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do 2019-11-27T14:57:36.587 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:36.587 INFO:teuthology.orchestra.run.smithi156.stdout:Total 3.3 MB/s | 4.5 MB 00:01 2019-11-27T14:57:36.593 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:36.602 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2019-11-27T14:57:36.603 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:36.785 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:36.785 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:36.854 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:36.901 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:36.902 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:36.902 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:36.902 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:36.903 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:37.435 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-27T14:57:37.586 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:37.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-27T14:57:37.935 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:57:37.935 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:37.935 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:37.938 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:57:37.969 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:57:37.970 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:37.970 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:37.971 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-27T14:57:37.971 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-27T14:57:37.972 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:37.972 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-27T14:57:38.357 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:38.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:57:38.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:38.591 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-27T14:57:38.592 INFO:teuthology.orchestra.run.smithi003.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+3 Dependent packages) 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 4.5 M 2019-11-27T14:57:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 20 M 2019-11-27T14:57:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:57:39.022 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-27T14:57:39.417 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-27T14:57:39.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-27T14:57:39.636 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-27T14:57:39.777 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-27T14:57:40.477 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:40.477 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.4 MB/s | 4.5 MB 00:01 2019-11-27T14:57:40.483 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:57:40.493 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:57:40.696 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:57:40.697 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:57:41.022 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-27T14:57:41.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:41.022 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-27T14:57:41.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:41.024 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:57:41.148 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-27T14:57:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-27T14:57:41.399 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:41.442 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:41.443 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:41.444 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:41.444 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:41.444 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-27T14:57:42.092 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:42.428 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:57:42.428 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:42.428 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:42.795 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:43.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:43.023 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:43.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-cloud 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-27T14:57:43.024 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 82 k 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 411 k 2019-11-27T14:57:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:43.364 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:43.368 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:43.423 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:43.423 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:43.529 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-27T14:57:43.887 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-27T14:57:44.020 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-27T14:57:44.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T14:57:44.170 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-27T14:57:44.295 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-27T14:57:44.542 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T14:57:44.542 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:44.542 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:57:44.543 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:44.543 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:44.543 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:57:44.657 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-27T14:57:44.794 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-27T14:57:44.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:44.794 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:57:44.794 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:44.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:44.795 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:57:44.921 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:44.927 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-27T14:57:44.966 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:44.968 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:44.968 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:44.968 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:44.969 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:45.185 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:45.224 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:45.226 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:45.226 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:45.226 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:45.227 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:45.618 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:45.888 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:57:45.967 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:57:45.968 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:45.968 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:45.970 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:57:46.000 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:46.000 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-27T14:57:46.007 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:57:46.008 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:57:46.010 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:57:46.010 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:46.010 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-27T14:57:46.011 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-27T14:57:46.012 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T14:57:46.013 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T14:57:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:57:46.014 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-27T14:57:46.226 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:57:46.227 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:57:46.227 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:57:46.375 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:46.601 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:46.602 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:57:46.603 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-27T14:57:46.604 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 19 M 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 104 M 2019-11-27T14:57:46.605 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:57:46.613 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:57:46.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:46.846 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:57:46.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:46.847 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:46.847 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:57:46.847 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-cloud 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:57:46.848 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:57:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2019-11-27T14:57:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 82 k 2019-11-27T14:57:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 411 k 2019-11-27T14:57:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:57:47.191 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:57:47.195 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:57:47.250 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:57:47.251 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:57:47.376 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:57:47.376 INFO:teuthology.orchestra.run.smithi156.stdout:Total 25 MB/s | 19 MB 00:00 2019-11-27T14:57:47.386 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:57:47.411 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:57:47.563 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:57:47.564 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:57:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T14:57:48.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-27T14:57:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-27T14:57:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:48.374 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:57:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:57:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:57:48.375 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:57:48.512 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-27T14:57:48.778 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:57:48.823 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:57:48.824 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:57:48.824 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:57:48.825 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:57:48.825 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:57:48.898 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T14:57:49.510 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:05.666 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-27T14:58:05.666 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T14:58:05.667 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-27T14:58:05.668 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:58:05.669 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-27T14:58:05.670 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:05.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-27T14:58:05.672 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:05.673 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 19 M 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 104 M 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:05.674 INFO:teuthology.orchestra.run.smithi003.stdout:Total 15 MB/s | 19 MB 00:01 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T14:58:05.675 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-27T14:58:05.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-27T14:58:05.677 INFO:teuthology.orchestra.run.smithi003.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-27T14:58:05.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:05.678 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:05.678 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-rook 2019-11-27T14:58:05.679 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2019-11-27T14:58:05.887 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:05.925 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:05.926 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:05.927 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:05.927 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:05.927 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:05.945 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:05.990 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:05.991 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:05.992 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:05.992 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:05.992 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:06.536 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:06.653 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:06.862 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:06.862 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:06.862 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:06.864 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:58:06.894 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:06.894 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-27T14:58:06.896 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:06.897 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:06.898 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:06.899 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:06.900 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:06.900 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-27T14:58:06.900 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-27T14:58:06.901 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-27T14:58:06.901 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:06.902 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:06.903 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:06.904 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-27T14:58:06.904 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-27T14:58:06.905 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:06.905 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-27T14:58:06.905 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-27T14:58:06.906 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-27T14:58:06.906 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-27T14:58:06.907 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-27T14:58:06.907 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:06.907 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-27T14:58:07.000 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:07.000 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:07.000 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:07.002 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:58:07.033 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:07.033 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-27T14:58:07.035 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:07.036 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:07.037 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:07.038 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-27T14:58:07.039 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:07.040 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-27T14:58:07.040 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-27T14:58:07.040 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-27T14:58:07.041 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:07.042 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:07.043 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-27T14:58:07.044 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-27T14:58:07.044 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-27T14:58:07.045 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:07.045 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-27T14:58:07.045 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-27T14:58:07.046 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-27T14:58:07.046 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-27T14:58:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-27T14:58:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-27T14:58:07.272 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:07.433 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:07.500 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:07.500 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:07.501 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-27T14:58:07.502 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-27T14:58:07.503 INFO:teuthology.orchestra.run.smithi156.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:07.504 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+10 Dependent packages) 2019-11-27T14:58:07.505 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:07.505 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.6 M 2019-11-27T14:58:07.505 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 24 M 2019-11-27T14:58:07.506 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:07.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:07.667 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:07.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:07.669 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:07.669 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:58:07.669 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:07.669 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-27T14:58:07.670 INFO:teuthology.orchestra.run.smithi003.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:07.671 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:07.672 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:07.672 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+10 Dependent packages) 2019-11-27T14:58:07.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:07.673 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.6 M 2019-11-27T14:58:07.673 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 24 M 2019-11-27T14:58:07.673 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:08.363 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:08.364 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.9 MB/s | 1.6 MB 00:00 2019-11-27T14:58:08.380 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:08.392 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:08.503 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:08.504 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:08.529 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:08.529 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.9 MB/s | 1.6 MB 00:00 2019-11-27T14:58:08.546 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:08.665 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:08.666 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:09.227 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-27T14:58:09.385 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-27T14:58:09.632 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-27T14:58:09.771 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-27T14:58:10.031 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-27T14:58:10.139 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-27T14:58:10.325 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-27T14:58:10.393 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-27T14:58:10.733 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-27T14:58:10.988 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-27T14:58:11.114 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T14:58:11.371 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T14:58:11.515 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-27T14:58:11.760 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-27T14:58:11.853 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-27T14:58:12.080 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-27T14:58:13.227 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-27T14:58:13.433 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-27T14:58:13.612 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-27T14:58:13.786 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-27T14:58:13.873 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-27T14:58:13.980 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-27T14:58:14.089 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-27T14:58:14.097 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-27T14:58:14.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-27T14:58:14.214 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-27T14:58:14.314 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-27T14:58:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-27T14:58:14.414 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-27T14:58:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-27T14:58:14.523 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-27T14:58:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T14:58:14.665 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-27T14:58:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-27T14:58:14.766 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-27T14:58:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-27T14:58:14.866 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-27T14:58:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-27T14:58:15.013 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-27T14:58:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-27T14:58:15.142 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-27T14:58:15.268 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-27T14:58:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-27T14:58:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-27T14:58:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:15.546 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-ssh 2019-11-27T14:58:15.797 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-27T14:58:15.797 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:15.797 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-27T14:58:15.798 INFO:teuthology.orchestra.run.smithi156.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-27T14:58:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:15.800 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:15.801 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:15.846 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:15.919 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-ssh 2019-11-27T14:58:16.185 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:16.231 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:16.233 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:16.233 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:16.233 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:16.234 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:16.861 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:58:16.895 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-27T14:58:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-27T14:58:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-27T14:58:16.898 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:17.239 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:17.239 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:17.239 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:17.242 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-27T14:58:17.271 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:17.272 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-27T14:58:17.272 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-27T14:58:17.273 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:17.273 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-27T14:58:17.285 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:17.520 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:17.521 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-27T14:58:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+2 Dependent packages) 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 313 k 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.1 M 2019-11-27T14:58:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:17.639 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:17.866 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:17.867 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:17.867 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:17.867 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:58:17.868 INFO:teuthology.orchestra.run.smithi156.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+2 Dependent packages) 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:17.869 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 313 k 2019-11-27T14:58:17.870 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 1.1 M 2019-11-27T14:58:17.870 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:18.097 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:18.097 INFO:teuthology.orchestra.run.smithi003.stdout:Total 545 kB/s | 313 kB 00:00 2019-11-27T14:58:18.101 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:18.188 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:18.188 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:18.405 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:18.405 INFO:teuthology.orchestra.run.smithi156.stdout:Total 584 kB/s | 313 kB 00:00 2019-11-27T14:58:18.409 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:18.418 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:18.498 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:18.499 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-27T14:58:19.324 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-27T14:58:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-27T14:58:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T14:58:19.651 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-27T14:58:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-27T14:58:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-27T14:58:19.962 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-27T14:58:21.302 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-27T14:58:21.303 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:21.304 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:21.304 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2019-11-27T14:58:21.365 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-fuse 2019-11-27T14:58:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:21.592 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:21.628 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:21.635 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:21.636 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:21.637 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:21.637 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:21.637 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:22.279 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:22.612 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:22.613 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:22.613 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:22.623 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:22.651 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:22.652 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:22.652 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:22.656 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:22.656 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:22.656 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T14:58:22.656 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.658 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.659 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.660 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.660 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:22.661 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T14:58:22.663 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:22.666 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-27T14:58:22.666 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-27T14:58:22.697 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:22.697 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T14:58:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.701 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.702 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-27T14:58:22.703 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:22.703 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-27T14:58:22.709 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-27T14:58:22.709 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-27T14:58:23.031 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:23.098 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:23.257 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:23.258 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:23.258 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:23.258 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:23.258 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-27T14:58:23.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:58:23.260 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:23.261 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 10 M 2019-11-27T14:58:23.261 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 49 M 2019-11-27T14:58:23.261 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:23.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:23.331 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:23.333 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:23.334 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+4 Dependent packages) 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 10 M 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 49 M 2019-11-27T14:58:23.335 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:24.244 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:24.244 INFO:teuthology.orchestra.run.smithi156.stdout:Total 10 MB/s | 10 MB 00:00 2019-11-27T14:58:24.265 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:24.294 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:24.308 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:24.308 INFO:teuthology.orchestra.run.smithi003.stdout:Total 10 MB/s | 10 MB 00:00 2019-11-27T14:58:24.329 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:24.358 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:24.428 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:24.428 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:24.629 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:24.629 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:26.860 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-27T14:58:27.229 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-27T14:58:39.103 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-27T14:58:39.104 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-27T14:58:39.106 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-27T14:58:39.106 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:39.106 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:39.106 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs2 2019-11-27T14:58:39.107 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-27T14:58:39.107 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-27T14:58:39.107 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-27T14:58:39.107 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:58:39.107 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:39.108 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:39.109 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:39.110 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2019-11-27T14:58:39.383 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:39.384 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:39.430 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:39.431 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:39.432 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:39.432 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:39.433 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:39.433 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:39.433 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:39.433 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:39.434 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:39.434 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:40.085 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:40.100 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:40.426 INFO:teuthology.orchestra.run.smithi156.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:40.427 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do 2019-11-27T14:58:40.447 INFO:teuthology.orchestra.run.smithi003.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:40.447 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do 2019-11-27T14:58:40.488 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs-devel 2019-11-27T14:58:40.509 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2019-11-27T14:58:40.643 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:40.677 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:40.678 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:40.678 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:40.679 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:40.679 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:40.684 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:40.721 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:41.259 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:41.337 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:41.582 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:41.583 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:41.583 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:41.583 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:41.613 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:41.613 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:41.675 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:41.676 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:41.676 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:41.676 INFO:teuthology.orchestra.run.smithi003.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-27T14:58:41.707 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:41.708 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:41.986 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:42.101 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:42.215 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:42.216 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:42.216 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:42.217 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:42.218 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package (+1 Dependent package) 2019-11-27T14:58:42.219 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:42.219 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 170 k 2019-11-27T14:58:42.219 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 679 k 2019-11-27T14:58:42.219 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:42.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:42.338 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:42.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-27T14:58:42.339 INFO:teuthology.orchestra.run.smithi003.stdout:Installing for dependencies: 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package (+1 Dependent package) 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:42.340 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 170 k 2019-11-27T14:58:42.341 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 679 k 2019-11-27T14:58:42.341 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:42.617 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:42.617 INFO:teuthology.orchestra.run.smithi156.stdout:Total 424 kB/s | 170 kB 00:00 2019-11-27T14:58:42.620 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:42.632 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:42.635 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:42.636 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:42.748 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2019-11-27T14:58:42.748 INFO:teuthology.orchestra.run.smithi003.stdout:Total 415 kB/s | 170 kB 00:00 2019-11-27T14:58:42.751 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:42.763 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:42.766 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:42.766 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:43.209 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T14:58:43.436 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T14:58:43.463 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T14:58:43.576 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T14:58:43.715 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T14:58:43.822 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:44.045 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T14:58:44.046 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:44.046 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:44.046 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:44.164 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install librados2 2019-11-27T14:58:44.257 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-27T14:58:44.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:44.257 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:44.257 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:44.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:44.258 INFO:teuthology.orchestra.run.smithi003.stdout:Dependency Installed: 2019-11-27T14:58:44.258 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:44.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:44.258 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:44.377 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2019-11-27T14:58:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:44.436 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:44.436 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:44.436 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:44.437 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:44.632 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:44.677 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:44.678 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:44.679 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:44.679 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:44.679 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:45.078 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:45.348 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:45.410 INFO:teuthology.orchestra.run.smithi156.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:45.411 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do 2019-11-27T14:58:45.472 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install librbd1 2019-11-27T14:58:45.687 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:45.697 INFO:teuthology.orchestra.run.smithi003.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:45.697 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do 2019-11-27T14:58:45.732 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:45.733 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:45.733 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:45.733 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:45.734 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:45.759 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2019-11-27T14:58:46.014 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:46.060 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:46.061 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:46.061 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:46.062 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:46.062 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:46.396 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:46.726 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:46.730 INFO:teuthology.orchestra.run.smithi156.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:46.730 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do 2019-11-27T14:58:46.793 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install python-ceph 2019-11-27T14:58:46.956 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:46.991 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:46.991 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:46.992 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:46.992 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:46.992 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:47.074 INFO:teuthology.orchestra.run.smithi003.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-27T14:58:47.074 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do 2019-11-27T14:58:47.136 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install python-ceph 2019-11-27T14:58:47.364 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:47.405 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:47.566 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:47.892 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:47.893 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:47.893 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:48.072 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:48.261 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:48.414 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:48.415 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:48.415 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:48.490 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: Size 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.2 k 2019-11-27T14:58:48.492 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 0 2019-11-27T14:58:48.493 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:48.805 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:48.953 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:48.955 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:48.957 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:48.957 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:49.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:49.040 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout: Size 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:49.041 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:49.042 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.2 k 2019-11-27T14:58:49.043 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 0 2019-11-27T14:58:49.043 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:49.490 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:49.491 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:49.492 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:49.494 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:49.495 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:49.933 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:49.933 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:49.933 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:49.934 INFO:teuthology.orchestra.run.smithi156.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:49.934 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:49.934 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:50.021 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:50.052 INFO:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-fuse 2019-11-27T14:58:50.288 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:50.330 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:50.331 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:50.331 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:50.331 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:50.332 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:50.511 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:50.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:50.512 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:50.512 INFO:teuthology.orchestra.run.smithi003.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:50.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:50.512 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:50.640 INFO:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2019-11-27T14:58:50.899 INFO:teuthology.orchestra.run.smithi003.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T14:58:50.943 INFO:teuthology.orchestra.run.smithi003.stdout:Loading mirror speeds from cached hostfile 2019-11-27T14:58:50.944 INFO:teuthology.orchestra.run.smithi003.stdout: * base: mirror.math.princeton.edu 2019-11-27T14:58:50.945 INFO:teuthology.orchestra.run.smithi003.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T14:58:50.945 INFO:teuthology.orchestra.run.smithi003.stdout: * extras: mirror.vcu.edu 2019-11-27T14:58:50.945 INFO:teuthology.orchestra.run.smithi003.stdout: * updates: mirror.umd.edu 2019-11-27T14:58:50.983 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:51.316 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T14:58:51.316 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T14:58:51.317 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:51.609 INFO:teuthology.orchestra.run.smithi003.stdout:7 packages excluded due to repository priority protections 2019-11-27T14:58:51.696 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:51.926 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:51.927 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T14:58:51.927 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:51.927 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:51.928 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 76 k 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 200 k 2019-11-27T14:58:51.929 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T14:58:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:Resolving Dependencies 2019-11-27T14:58:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:--> Running transaction check 2019-11-27T14:58:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-27T14:58:52.360 INFO:teuthology.orchestra.run.smithi003.stdout:--> Finished Dependency Resolution 2019-11-27T14:58:52.532 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T14:58:52.554 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T14:58:52.556 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T14:58:52.559 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T14:58:52.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:52.596 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies Resolved 2019-11-27T14:58:52.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:52.597 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 76 k 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 200 k 2019-11-27T14:58:52.598 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading packages: 2019-11-27T14:58:53.112 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:53.201 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2019-11-27T14:58:53.224 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2019-11-27T14:58:53.226 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded 2019-11-27T14:58:53.226 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2019-11-27T14:58:53.628 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:53.628 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:53.628 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T14:58:53.628 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:53.629 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T14:58:53.629 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T14:58:53.700 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:53.750 DEBUG:teuthology.parallel:result is None 2019-11-27T14:58:54.191 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-27T14:58:54.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:54.192 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2019-11-27T14:58:54.192 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-27T14:58:54.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2019-11-27T14:58:54.192 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2019-11-27T14:58:54.308 DEBUG:teuthology.parallel:result is None 2019-11-27T14:58:54.309 INFO:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2019-11-27T14:58:54.453 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS 2019-11-27T14:58:54.455 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:58:54.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T14:58:54.628 INFO:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-27T14:58:54.769 INFO:teuthology.orchestra.run.smithi156.stdout:15.0.0-7725.g0073295.el7 2019-11-27T14:58:54.769 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-27T14:58:54.769 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-27T14:58:54.770 INFO:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2019-11-27T14:58:54.925 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2019-11-27T14:58:54.927 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-27T14:58:54.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T14:58:55.081 INFO:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-27T14:58:55.218 INFO:teuthology.orchestra.run.smithi003.stdout:15.0.0-7725.g0073295.el7 2019-11-27T14:58:55.218 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-27T14:58:55.219 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-27T14:58:55.219 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-27T14:58:55.219 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-27T14:58:55.341 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-27T14:58:55.468 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-27T14:58:55.468 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-27T14:58:55.589 INFO:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-27T14:58:55.685 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-27T14:58:55.809 INFO:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-27T14:58:55.915 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-27T14:59:06.565 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-27T14:59:06.685 INFO:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-27T14:59:06.778 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-27T14:59:06.903 INFO:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-27T14:59:07.017 INFO:teuthology.run_tasks:Running task ceph... 2019-11-27T14:59:08.057 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-27T14:59:08.057 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2019-11-27T14:59:08.063 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2019-11-27T14:59:08.179 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-27T14:59:08.180 INFO:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-27T14:59:08.184 INFO:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-27T14:59:08.294 INFO:tasks.ceph:Creating extra log directories... 2019-11-27T14:59:08.294 INFO:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-27T14:59:08.300 INFO:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-27T14:59:08.405 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-27T14:59:08.405 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-27T14:59:08.405 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.4309', 'owner': 'scheduled_mkogan@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi156.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCdp8Gj3/TmzwM5CIQtjS6iSDDwF+ZabNNsx2UM/jFQFIjaOXr7/zdpgeRXsJ7zl7uzPt8N+ZfKSGFFEZoHDGXmD5Jpu4DvPFU6Qs5+lB7tJeWGaK3Rmxb2PkYGggtrHaAlMxxi3KxFPcLvw8AY/Ej6HM9yoNwI+zZZ37Qf5/YXUstnDr7LL1mUEAZR2r8tsmv6gat3JDW+kOges/RiAubLP279sVgrUesjFFK77hs9lSfcov70MsZKCi77TOTYruAG5CIN0bpvEznTqb1XIpjZ7sDpcFLYWtIfpH89cNlpmCkIOn6PQLsBFKGBETkIApimusMkv7qTKZQLCPZSGfH', 'smithi003.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDbfcm/22npjzUNSYeInycTT0J+QiMU27HTcWyN5iaMIKJCJZKvbcRsmvn6vKthwATXwsWwzw5ivz1UEMPEUody9WiJFgrqoaglYhvNl7QgCwPz4HBoAm+4wWzfuqumOI3Ul6DpZ2AcTPyYH6SvJwXgHu77sYa77awloxCopIhHR2mgKbUEcAmKrslDUq6s0d2an6mfIYsXHYS9XwhH8bFa1JSnedq8q9Pisz4RrcviJyoTQrCGgGrDWcIgFQ3cUy2ouJYaNDPnbMiEQ3+jqcc7pUHl6UapHtbR23K7lIIXtLMGAKMm+U8WN59LGivgwoGGqAEW4QRAqUwbC8v4CLGX'}, 'job_id': '4547447', 'tube': 'smithi', 'suite_branch': 'wip-mkogan-testing', 'priority': 90, 'first_in_suite': False, 'branch': 'wip-mkogan-testing', 'suite': 'rgw:verify', 'email': 'mkogan@redhat.com', 'archive_path': '/home/teuthworker/archive/mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4547447', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'name': 'mkogan-2019-11-27_11:58:42-rgw:verify-wip-mkogan-testing-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'os_type': 'centos', 'overrides': {'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'beast', 'ec-data-pool': False, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'workunit': {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'branch': 'wip-mkogan-testing'}, 'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, 'admin_socket': {'branch': 'wip-mkogan-testing'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}} 2019-11-27T14:59:08.406 INFO:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-27T14:59:08.411 INFO:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-27T14:59:08.491 INFO:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2019-11-27T14:59:08.496 INFO:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2019-11-27T14:59:08.683 DEBUG:teuthology.orchestra.remote:smithi156:/scratch_devs is 72B 2019-11-27T14:59:08.770 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T14:59:08.770 INFO:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-27T14:59:08.845 INFO:teuthology.orchestra.run.smithi156.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-27T14:59:08.845 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:08.845 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 102985 Links: 1 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2019-11-27 14:57:24.639154464 +0000 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2019-11-27 14:55:36.715915832 +0000 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2019-11-27 14:55:36.715915832 +0000 2019-11-27T14:59:08.846 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2019-11-27T14:59:08.872 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2019-11-27T14:59:08.873 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2019-11-27T14:59:08.873 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes (512 B) copied, 0.000315392 s, 1.6 MB/s 2019-11-27T14:59:08.877 INFO:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-27T14:59:08.953 INFO:teuthology.orchestra.run.smithi156.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-27T14:59:08.953 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:08.953 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 103019 Links: 1 2019-11-27T14:59:08.953 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:08.954 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:08.954 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2019-11-27 14:57:24.639154464 +0000 2019-11-27T14:59:08.954 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2019-11-27 14:55:37.177908494 +0000 2019-11-27T14:59:08.954 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2019-11-27 14:55:37.177908494 +0000 2019-11-27T14:59:08.954 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2019-11-27T14:59:08.978 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2019-11-27T14:59:08.978 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2019-11-27T14:59:08.979 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes (512 B) copied, 0.000351301 s, 1.5 MB/s 2019-11-27T14:59:08.983 INFO:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-27T14:59:09.046 INFO:teuthology.orchestra.run.smithi156.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-27T14:59:09.046 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.046 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 109656 Links: 1 2019-11-27T14:59:09.046 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.046 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.047 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2019-11-27 14:57:24.639154464 +0000 2019-11-27T14:59:09.047 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2019-11-27 14:55:37.653900934 +0000 2019-11-27T14:59:09.047 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2019-11-27 14:55:37.653900934 +0000 2019-11-27T14:59:09.047 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2019-11-27T14:59:09.066 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2019-11-27T14:59:09.066 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2019-11-27T14:59:09.066 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes (512 B) copied, 0.000315541 s, 1.6 MB/s 2019-11-27T14:59:09.070 INFO:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-27T14:59:09.125 INFO:teuthology.orchestra.run.smithi156.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 109697 Links: 1 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2019-11-27 14:57:24.640154464 +0000 2019-11-27T14:59:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2019-11-27 14:55:38.142893168 +0000 2019-11-27T14:59:09.127 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2019-11-27 14:55:38.142893168 +0000 2019-11-27T14:59:09.127 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2019-11-27T14:59:09.143 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2019-11-27T14:59:09.144 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2019-11-27T14:59:09.144 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes (512 B) copied, 0.000302944 s, 1.7 MB/s 2019-11-27T14:59:09.147 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-27T14:59:09.147 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T14:59:09.147 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-27T14:59:09.147 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:09.241 DEBUG:teuthology.orchestra.remote:smithi003:/scratch_devs is 72B 2019-11-27T14:59:09.330 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T14:59:09.330 INFO:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-27T14:59:09.406 INFO:teuthology.orchestra.run.smithi003.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-27T14:59:09.406 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.406 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 96895 Links: 1 2019-11-27T14:59:09.406 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.406 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.407 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2019-11-27 14:57:28.155887877 +0000 2019-11-27T14:59:09.407 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2019-11-27 14:52:00.671990776 +0000 2019-11-27T14:59:09.407 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2019-11-27 14:52:00.671990776 +0000 2019-11-27T14:59:09.407 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2019-11-27T14:59:09.435 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2019-11-27T14:59:09.435 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2019-11-27T14:59:09.435 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes (512 B) copied, 0.000429303 s, 1.2 MB/s 2019-11-27T14:59:09.441 INFO:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-27T14:59:09.506 INFO:teuthology.orchestra.run.smithi003.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 96924 Links: 1 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2019-11-27 14:57:28.155887877 +0000 2019-11-27T14:59:09.507 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2019-11-27 14:52:01.150981224 +0000 2019-11-27T14:59:09.508 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2019-11-27 14:52:01.150981224 +0000 2019-11-27T14:59:09.508 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2019-11-27T14:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2019-11-27T14:59:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2019-11-27T14:59:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes (512 B) copied, 0.00038376 s, 1.3 MB/s 2019-11-27T14:59:09.538 INFO:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-27T14:59:09.622 INFO:teuthology.orchestra.run.smithi003.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-27T14:59:09.622 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.622 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 103761 Links: 1 2019-11-27T14:59:09.623 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.623 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.623 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2019-11-27 14:57:28.155887877 +0000 2019-11-27T14:59:09.623 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2019-11-27 14:52:01.617971911 +0000 2019-11-27T14:59:09.623 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2019-11-27 14:52:01.617971911 +0000 2019-11-27T14:59:09.624 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2019-11-27T14:59:09.647 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2019-11-27T14:59:09.647 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2019-11-27T14:59:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes (512 B) copied, 0.000379706 s, 1.3 MB/s 2019-11-27T14:59:09.652 INFO:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-27T14:59:09.726 INFO:teuthology.orchestra.run.smithi003.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-27T14:59:09.726 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-27T14:59:09.726 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 108664 Links: 1 2019-11-27T14:59:09.726 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-27T14:59:09.726 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2019-11-27T14:59:09.727 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2019-11-27 14:57:28.155887877 +0000 2019-11-27T14:59:09.727 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2019-11-27 14:52:02.094962399 +0000 2019-11-27T14:59:09.727 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2019-11-27 14:52:02.094962399 +0000 2019-11-27T14:59:09.727 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2019-11-27T14:59:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2019-11-27T14:59:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2019-11-27T14:59:09.756 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes (512 B) copied, 0.000442346 s, 1.2 MB/s 2019-11-27T14:59:09.761 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-27T14:59:09.762 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-27T14:59:09.762 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-27T14:59:09.762 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:09.762 INFO:tasks.ceph:Generating config... 2019-11-27T14:59:09.763 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-27T14:59:09.763 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-27T14:59:09.764 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-27T14:59:09.764 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-27T14:59:09.764 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-27T14:59:09.764 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-11-27T14:59:09.764 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-27T14:59:09.764 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-11-27T14:59:09.764 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-27T14:59:09.765 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-11-27T14:59:09.766 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-11-27T14:59:09.766 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-11-27T14:59:09.766 INFO:tasks.ceph:[osd] bdev async discard = True 2019-11-27T14:59:09.766 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-11-27T14:59:09.766 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-11-27T14:59:09.767 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-27T14:59:09.767 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-11-27T14:59:09.767 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-11-27T14:59:09.767 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-27T14:59:09.767 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-27T14:59:09.767 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-27T14:59:09.767 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-27T14:59:09.768 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-27T14:59:09.768 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-27T14:59:09.768 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-27T14:59:09.768 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-27T14:59:09.769 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-27T14:59:09.769 INFO:tasks.ceph:Setting up mon.a... 2019-11-27T14:59:09.769 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-27T14:59:09.957 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.keyring 2019-11-27T14:59:09.962 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-27T14:59:10.112 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T14:59:10.229 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'), ('mon.b', '172.21.15.3')] 2019-11-27T14:59:10.229 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --add b 172.21.15.3 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:10.376 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: generated fsid d4e77d13-5c26-488a-bbfb-ae1f2ac96e57 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:epoch 0 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:fsid d4e77d13-5c26-488a-bbfb-ae1f2ac96e57 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:last_changed 2019-11-27T14:59:10.379717+0000 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:created 2019-11-27T14:59:10.379717+0000 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:min_mon_release 0 (unknown) 2019-11-27T14:59:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:0: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.a 2019-11-27T14:59:10.378 INFO:teuthology.orchestra.run.smithi156.stdout:1: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.b 2019-11-27T14:59:10.378 INFO:teuthology.orchestra.run.smithi156.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2019-11-27T14:59:10.378 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-27T14:59:10.379 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d4e77d13-5c26-488a-bbfb-ae1f2ac96e57... 2019-11-27T14:59:10.380 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-27T14:59:10.385 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-27T14:59:10.593 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-27T14:59:10.593 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-27T14:59:10.759 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-27T14:59:10.844 DEBUG:teuthology.orchestra.remote:smithi156:/etc/ceph/ceph.keyring is 206B 2019-11-27T14:59:11.011 DEBUG:teuthology.orchestra.remote:smithi156:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-27T14:59:11.095 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:59:11.095 INFO:teuthology.orchestra.run.smithi156:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T14:59:11.208 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:11.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:59:11.276 INFO:teuthology.orchestra.run.smithi003:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-27T14:59:11.430 INFO:teuthology.orchestra.run.smithi003:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:11.513 INFO:tasks.ceph:Setting up mon nodes... 2019-11-27T14:59:11.514 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-27T14:59:11.514 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-27T14:59:11.685 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-27T14:59:11.689 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-27T14:59:11.903 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-27T14:59:11.908 INFO:tasks.ceph:Setting up mds nodes... 2019-11-27T14:59:11.908 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-27T14:59:11.909 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-27T14:59:12.056 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-27T14:59:12.085 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-27T14:59:12.245 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-27T14:59:12.281 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-27T14:59:12.281 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-11-27T14:59:12.281 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-27T14:59:12.403 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:12.403 INFO:tasks.ceph:{} 2019-11-27T14:59:12.404 INFO:tasks.ceph:osd.0 2019-11-27T14:59:12.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:59:12.404 INFO:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-27T14:59:12.999 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:12.999 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:12.999 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:12.999 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:12.999 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:13.000 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:13.000 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:13.000 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:13.000 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:13.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2019-11-27T14:59:13.003 INFO:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-27T14:59:13.185 INFO:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-27T14:59:13.302 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-27T14:59:13.417 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:13.417 INFO:tasks.ceph:{} 2019-11-27T14:59:13.417 INFO:tasks.ceph:osd.1 2019-11-27T14:59:13.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:59:13.418 INFO:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-27T14:59:13.966 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:13.966 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:13.966 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:13.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2019-11-27T14:59:13.969 INFO:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-27T14:59:14.116 INFO:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-27T14:59:14.206 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-27T14:59:14.284 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:14.284 INFO:tasks.ceph:{} 2019-11-27T14:59:14.284 INFO:tasks.ceph:osd.2 2019-11-27T14:59:14.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:59:14.285 INFO:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-27T14:59:14.870 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:14.870 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:14.870 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:14.870 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:14.871 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:14.871 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:14.871 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:14.871 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:14.871 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:14.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2019-11-27T14:59:14.873 INFO:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-27T14:59:15.035 INFO:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-27T14:59:15.160 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-27T14:59:15.270 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:15.270 INFO:tasks.ceph:{} 2019-11-27T14:59:15.271 INFO:tasks.ceph:osd.3 2019-11-27T14:59:15.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T14:59:15.271 INFO:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-27T14:59:15.850 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:15.850 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:15.850 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:15.851 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:15.853 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2019-11-27T14:59:15.853 INFO:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-27T14:59:15.995 INFO:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-27T14:59:16.086 INFO:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:16.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.208+0000 7fd49af42b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-27T14:59:16.207 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.209+0000 7fd49af42b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-27T14:59:16.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.209+0000 7fd49af42b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-27T14:59:16.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.209+0000 7fd49af42b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-27T14:59:16.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.209+0000 7fd49af42b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-27T14:59:16.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:16.215+0000 7fd49af42b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-11-27T14:59:18.524 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-27T14:59:18.642 INFO:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.795+0000 7f4bfeeefb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-27T14:59:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.795+0000 7f4bfeeefb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-27T14:59:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.796+0000 7f4bfeeefb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-27T14:59:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.796+0000 7f4bfeeefb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-27T14:59:18.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.796+0000 7f4bfeeefb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-27T14:59:18.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:18.797+0000 7f4bfeeefb40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-11-27T14:59:21.101 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-27T14:59:21.259 INFO:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:21.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.411+0000 7f6a1645ab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-27T14:59:21.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.412+0000 7f6a1645ab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-27T14:59:21.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.412+0000 7f6a1645ab40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-27T14:59:21.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.412+0000 7f6a1645ab40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-27T14:59:21.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.412+0000 7f6a1645ab40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-27T14:59:21.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:21.413+0000 7f6a1645ab40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-11-27T14:59:23.717 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-27T14:59:23.836 INFO:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:23.991 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.994+0000 7f3b9b0ddb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-27T14:59:23.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.994+0000 7f3b9b0ddb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-27T14:59:23.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.994+0000 7f3b9b0ddb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-27T14:59:23.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.994+0000 7f3b9b0ddb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-27T14:59:23.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.994+0000 7f3b9b0ddb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-27T14:59:23.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T14:59:23.996+0000 7f3b9b0ddb40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-11-27T14:59:26.301 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-27T14:59:26.418 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-27T14:59:26.539 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:26.539 INFO:tasks.ceph:{} 2019-11-27T14:59:26.539 INFO:tasks.ceph:osd.4 2019-11-27T14:59:26.539 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:59:26.540 INFO:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-27T14:59:27.119 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:27.120 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:27.121 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:27.121 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:27.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2019-11-27T14:59:27.123 INFO:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-27T14:59:27.311 INFO:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-27T14:59:27.434 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-27T14:59:27.546 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:27.546 INFO:tasks.ceph:{} 2019-11-27T14:59:27.546 INFO:tasks.ceph:osd.5 2019-11-27T14:59:27.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:59:27.547 INFO:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-27T14:59:28.105 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:28.105 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:28.106 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:28.108 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2019-11-27T14:59:28.108 INFO:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-27T14:59:28.253 INFO:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-27T14:59:28.380 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-27T14:59:28.491 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:28.491 INFO:tasks.ceph:{} 2019-11-27T14:59:28.492 INFO:tasks.ceph:osd.6 2019-11-27T14:59:28.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:59:28.492 INFO:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-27T14:59:29.072 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:29.072 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:29.072 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:29.072 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:29.072 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:29.073 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:29.073 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:29.073 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:29.073 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:29.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2019-11-27T14:59:29.074 INFO:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-27T14:59:29.237 INFO:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-27T14:59:29.356 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-27T14:59:29.475 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-27T14:59:29.475 INFO:tasks.ceph:{} 2019-11-27T14:59:29.476 INFO:tasks.ceph:osd.7 2019-11-27T14:59:29.476 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T14:59:29.476 INFO:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-27T14:59:30.022 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=0, sparse=0 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-27T14:59:30.023 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-27T14:59:30.024 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-27T14:59:30.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2019-11-27T14:59:30.025 INFO:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-27T14:59:30.179 INFO:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-27T14:59:30.286 INFO:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:30.409 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.410+0000 7f12609a4b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-27T14:59:30.411 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.412+0000 7f12609a4b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-27T14:59:30.411 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.412+0000 7f12609a4b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-27T14:59:30.411 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.412+0000 7f12609a4b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-27T14:59:30.412 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.412+0000 7f12609a4b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-27T14:59:30.415 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:30.416+0000 7f12609a4b40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-11-27T14:59:32.724 INFO:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-27T14:59:32.841 INFO:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:32.992 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.993+0000 7fc42e117b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-27T14:59:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.994+0000 7fc42e117b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-27T14:59:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.994+0000 7fc42e117b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-27T14:59:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.994+0000 7fc42e117b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-27T14:59:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.994+0000 7fc42e117b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-27T14:59:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:32.995+0000 7fc42e117b40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-11-27T14:59:35.301 INFO:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-27T14:59:35.420 INFO:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:35.581 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.582+0000 7fec626a2b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-27T14:59:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.583+0000 7fec626a2b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-27T14:59:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.583+0000 7fec626a2b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-27T14:59:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.583+0000 7fec626a2b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-27T14:59:35.582 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.583+0000 7fec626a2b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-27T14:59:35.583 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:35.584+0000 7fec626a2b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-11-27T14:59:37.894 INFO:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-27T14:59:41.054 INFO:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:41.187 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.188+0000 7f4bfd1dcb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-27T14:59:41.188 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.189+0000 7f4bfd1dcb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-27T14:59:41.188 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.189+0000 7f4bfd1dcb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-27T14:59:41.188 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.189+0000 7f4bfd1dcb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-27T14:59:41.189 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.189+0000 7f4bfd1dcb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-27T14:59:41.189 INFO:teuthology.orchestra.run.smithi003.stderr:2019-11-27T14:59:41.190+0000 7f4bfd1dcb40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-11-27T14:59:43.497 INFO:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-27T14:59:43.621 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-27T14:59:43.622 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:59:43.717 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.hUKAmz1vcd 2019-11-27T14:59:43.718 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.hUKAmz1vcd 2019-11-27T14:59:43.817 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.hUKAmz1vcd 2019-11-27T14:59:43.959 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.hUKAmz1vcd is 56B 2019-11-27T14:59:44.023 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.hUKAmz1vcd 2019-11-27T14:59:44.074 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:59:44.215 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.ILTqXsg215 2019-11-27T14:59:44.216 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.ILTqXsg215 2019-11-27T14:59:44.308 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.ILTqXsg215 2019-11-27T14:59:44.449 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.ILTqXsg215 is 56B 2019-11-27T14:59:44.510 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.ILTqXsg215 2019-11-27T14:59:44.564 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:59:44.710 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.QWKxVwz4sA 2019-11-27T14:59:44.710 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.QWKxVwz4sA 2019-11-27T14:59:44.805 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.QWKxVwz4sA 2019-11-27T14:59:44.940 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.QWKxVwz4sA is 56B 2019-11-27T14:59:44.996 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.QWKxVwz4sA 2019-11-27T14:59:45.046 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:59:45.182 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.5ai6AZ7PJA 2019-11-27T14:59:45.183 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.5ai6AZ7PJA 2019-11-27T14:59:45.286 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.5ai6AZ7PJA 2019-11-27T14:59:45.482 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.5ai6AZ7PJA is 56B 2019-11-27T14:59:45.573 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.5ai6AZ7PJA 2019-11-27T14:59:45.649 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T14:59:45.729 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.yRObewjup3 2019-11-27T14:59:45.730 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.yRObewjup3 2019-11-27T14:59:45.820 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.yRObewjup3 2019-11-27T14:59:45.951 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.yRObewjup3 is 56B 2019-11-27T14:59:46.008 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.yRObewjup3 2019-11-27T14:59:46.061 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:59:46.152 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.CXvhjiJf1v 2019-11-27T14:59:46.153 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.CXvhjiJf1v 2019-11-27T14:59:46.256 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.CXvhjiJf1v 2019-11-27T14:59:46.433 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.CXvhjiJf1v is 56B 2019-11-27T14:59:46.506 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.CXvhjiJf1v 2019-11-27T14:59:46.588 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:59:46.673 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.jYf9HYqxeA 2019-11-27T14:59:46.674 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.jYf9HYqxeA 2019-11-27T14:59:46.784 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.jYf9HYqxeA 2019-11-27T14:59:46.962 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.jYf9HYqxeA is 56B 2019-11-27T14:59:47.052 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.jYf9HYqxeA 2019-11-27T14:59:47.143 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:59:47.221 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.WIMxJ6Xzws 2019-11-27T14:59:47.222 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.WIMxJ6Xzws 2019-11-27T14:59:47.326 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.WIMxJ6Xzws 2019-11-27T14:59:47.500 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.WIMxJ6Xzws is 56B 2019-11-27T14:59:47.577 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.WIMxJ6Xzws 2019-11-27T14:59:47.644 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:59:47.710 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.3cYDVHobf2 2019-11-27T14:59:47.710 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.3cYDVHobf2 2019-11-27T14:59:47.806 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.3cYDVHobf2 2019-11-27T14:59:47.969 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.3cYDVHobf2 is 56B 2019-11-27T14:59:48.042 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.3cYDVHobf2 2019-11-27T14:59:48.110 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T14:59:48.178 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.oWrY8o4ge4 2019-11-27T14:59:48.178 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.oWrY8o4ge4 2019-11-27T14:59:48.273 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.oWrY8o4ge4 2019-11-27T14:59:48.446 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.oWrY8o4ge4 is 56B 2019-11-27T14:59:48.517 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.oWrY8o4ge4 2019-11-27T14:59:48.689 DEBUG:teuthology.orchestra.remote:smithi156:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-27T14:59:48.869 DEBUG:teuthology.orchestra.remote:smithi003:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-27T14:59:48.962 INFO:tasks.ceph:Adding keys to all mons... 2019-11-27T14:59:48.963 INFO:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-27T14:59:48.968 INFO:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-27T14:59:49.071 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2019-11-27T14:59:49.071 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA/j95dDKgMKRAATuelLEfVaogPTnibZ09pAA== 2019-11-27T14:59:49.071 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBEj95dD/J5DBAAJxSnnfGF+7IbOef0oHisKQ== 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBGj95dR714LxAANnPI+4sBYW5E3vEaPpisNw== 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBJj95dMk2cGBAA3V+SHytiP3oC+fpgXtqnhA== 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2019-11-27T14:59:49.072 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBLj95dB2lROxAAeDSx6ASlQuzyf+JQqxDycA== 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA/j95doZ4CNhAAipT51CAj54CLre0YTibuog== 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBSj95d8u2WGBAA80M65fiDwwi5u3F3KSXeMg== 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBUj95dFrBWOxAAuAtlu4Nzu9jsmvPLkRyj9A== 2019-11-27T14:59:49.073 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBXj95dfyfUIhAAyx+fgTJzUWBC2cQyv0zU1Q== 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBdj95dqLZWCxAATL0ck22L6cUuTkrIjDsEGw== 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBAj95doZ+MAxAAkKasOKuZYTmre6ObMHjYBw== 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2019-11-27T14:59:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBAj95dcsvJDhAADT+XYlV6Vn1ZyY4IWCrJDQ== 2019-11-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2019-11-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQA/j95dDKgMKRAATuelLEfVaogPTnibZ09pAA== 2019-11-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2019-11-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBEj95dD/J5DBAAJxSnnfGF+7IbOef0oHisKQ== 2019-11-27T14:59:49.081 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBGj95dR714LxAANnPI+4sBYW5E3vEaPpisNw== 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBJj95dMk2cGBAA3V+SHytiP3oC+fpgXtqnhA== 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBLj95dB2lROxAAeDSx6ASlQuzyf+JQqxDycA== 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2019-11-27T14:59:49.082 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQA/j95doZ4CNhAAipT51CAj54CLre0YTibuog== 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBSj95d8u2WGBAA80M65fiDwwi5u3F3KSXeMg== 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBUj95dFrBWOxAAuAtlu4Nzu9jsmvPLkRyj9A== 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBXj95dfyfUIhAAyx+fgTJzUWBC2cQyv0zU1Q== 2019-11-27T14:59:49.083 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2019-11-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBdj95dqLZWCxAATL0ck22L6cUuTkrIjDsEGw== 2019-11-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2019-11-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBAj95doZ+MAxAAkKasOKuZYTmre6ObMHjYBw== 2019-11-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2019-11-27T14:59:49.084 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBAj95dcsvJDhAADT+XYlV6Vn1ZyY4IWCrJDQ== 2019-11-27T14:59:49.085 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T14:59:49.090 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T14:59:49.239 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.243 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.412 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.416 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.583 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.588 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.760 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.767 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:49.940 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T14:59:49.944 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-27T14:59:50.120 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.125 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.289 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.296 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.433 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.438 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.602 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.606 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-27T14:59:50.779 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T14:59:50.784 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T14:59:50.955 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T14:59:50.959 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-27T14:59:51.133 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-27T14:59:51.133 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-27T14:59:51.236 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T14:59:51.412 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-27T14:59:51.521 INFO:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-27T14:59:51.602 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T14:59:51.720 INFO:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-27T14:59:51.800 INFO:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-27T14:59:51.926 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-27T14:59:52.088 INFO:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-27T14:59:52.194 INFO:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:52.204 INFO:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-27T14:59:52.294 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-27T14:59:52.294 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T14:59:52.294 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-27T14:59:52.294 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-27T14:59:52.299 INFO:tasks.ceph.mon.a:Started 2019-11-27T14:59:52.299 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T14:59:52.300 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-27T14:59:52.300 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-27T14:59:52.304 INFO:tasks.ceph.mon.c:Started 2019-11-27T14:59:52.304 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-27T14:59:52.304 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-27T14:59:52.305 INFO:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-27T14:59:52.309 INFO:tasks.ceph.mon.b:Started 2019-11-27T14:59:52.310 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-27T14:59:52.310 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-27T14:59:52.310 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-27T14:59:52.314 INFO:tasks.ceph.mgr.y:Started 2019-11-27T14:59:52.315 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-27T14:59:52.315 INFO:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-27T14:59:52.319 INFO:tasks.ceph.mgr.x:Started 2019-11-27T14:59:52.319 INFO:tasks.ceph:Setting crush tunables to default 2019-11-27T14:59:52.319 INFO:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd crush tunables default 2019-11-27T14:59:56.425 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:00:03.905 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:56.555 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:00:04.035 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T14:59:56.666 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:00:04.143 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:00:03.964 INFO:teuthology.orchestra.run.smithi156.stderr:adjusted tunables profile to default 2019-11-27T15:00:03.980 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-27T15:00:03.980 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T15:00:04.055 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.ESOI7Yt7RU 2019-11-27T15:00:04.055 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.ESOI7Yt7RU 2019-11-27T15:00:04.125 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.ESOI7Yt7RU 2019-11-27T15:00:04.228 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.ESOI7Yt7RU is 37B 2019-11-27T15:00:04.276 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.ESOI7Yt7RU 2019-11-27T15:00:04.318 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T15:00:04.436 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.XhzIXE9Pqd 2019-11-27T15:00:04.437 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.XhzIXE9Pqd 2019-11-27T15:00:04.502 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.XhzIXE9Pqd 2019-11-27T15:00:04.608 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.XhzIXE9Pqd is 37B 2019-11-27T15:00:04.656 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.XhzIXE9Pqd 2019-11-27T15:00:04.700 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T15:00:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.ZRpZAEjZCt 2019-11-27T15:00:04.821 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.ZRpZAEjZCt 2019-11-27T15:00:04.885 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.ZRpZAEjZCt 2019-11-27T15:00:04.995 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.ZRpZAEjZCt is 37B 2019-11-27T15:00:05.043 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.ZRpZAEjZCt 2019-11-27T15:00:05.085 INFO:teuthology.orchestra.run.smithi156:> mktemp 2019-11-27T15:00:05.219 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.f8zDYMKmOW 2019-11-27T15:00:05.219 INFO:teuthology.orchestra.run.smithi156:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.f8zDYMKmOW 2019-11-27T15:00:05.306 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.f8zDYMKmOW 2019-11-27T15:00:05.407 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.f8zDYMKmOW is 37B 2019-11-27T15:00:05.457 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.f8zDYMKmOW 2019-11-27T15:00:05.501 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T15:00:05.597 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.3h26H1jl5D 2019-11-27T15:00:05.598 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.3h26H1jl5D 2019-11-27T15:00:05.697 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.3h26H1jl5D 2019-11-27T15:00:05.813 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.3h26H1jl5D is 37B 2019-11-27T15:00:05.861 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.3h26H1jl5D 2019-11-27T15:00:05.904 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T15:00:06.027 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.dMJm2sZpLi 2019-11-27T15:00:06.028 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.dMJm2sZpLi 2019-11-27T15:00:06.094 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.dMJm2sZpLi 2019-11-27T15:00:06.216 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.dMJm2sZpLi is 37B 2019-11-27T15:00:06.270 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.dMJm2sZpLi 2019-11-27T15:00:06.312 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T15:00:06.428 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.LHwXgwIktM 2019-11-27T15:00:06.429 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.LHwXgwIktM 2019-11-27T15:00:06.500 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.LHwXgwIktM 2019-11-27T15:00:06.612 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.LHwXgwIktM is 37B 2019-11-27T15:00:06.663 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.LHwXgwIktM 2019-11-27T15:00:06.708 INFO:teuthology.orchestra.run.smithi003:> mktemp 2019-11-27T15:00:06.839 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.nCJ7lXkYsG 2019-11-27T15:00:06.839 INFO:teuthology.orchestra.run.smithi003:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.nCJ7lXkYsG 2019-11-27T15:00:06.921 INFO:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.nCJ7lXkYsG 2019-11-27T15:00:07.080 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.nCJ7lXkYsG is 37B 2019-11-27T15:00:07.150 INFO:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.nCJ7lXkYsG 2019-11-27T15:00:07.203 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 54884f34-334e-4aa9-b2fa-a2c4642a6dc4 0 2019-11-27T15:00:08.474 INFO:teuthology.orchestra.run.smithi003.stdout:0 2019-11-27T15:00:08.497 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 5b775534-72f8-4480-ac8d-8f986ab68626 1 2019-11-27T15:00:09.557 INFO:teuthology.orchestra.run.smithi003.stdout:1 2019-11-27T15:00:20.634 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 4df6eef7-9be7-4302-919f-dff355ef6f1e 2 2019-11-27T15:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:2 2019-11-27T15:00:21.923 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 826ec1e8-366e-4164-9642-2fd447e85368 3 2019-11-27T15:00:22.945 INFO:teuthology.orchestra.run.smithi003.stdout:3 2019-11-27T15:00:22.964 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 0a9a2eee-57ca-4b1f-a99e-07030c4f8b26 4 2019-11-27T15:00:23.912 INFO:teuthology.orchestra.run.smithi003.stdout:4 2019-11-27T15:00:23.937 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new 9a2713bd-0ac7-458c-a524-a0212b248e6d 5 2019-11-27T15:00:24.886 INFO:teuthology.orchestra.run.smithi003.stdout:5 2019-11-27T15:00:24.914 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new e71fe26e-da94-4d8b-9ce1-e9b53ffd7733 6 2019-11-27T15:00:25.933 INFO:teuthology.orchestra.run.smithi003.stdout:6 2019-11-27T15:00:25.955 INFO:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd new d44e20aa-a520-40bb-91ab-3b81fbdb847a 7 2019-11-27T15:00:27.201 INFO:teuthology.orchestra.run.smithi003.stdout:7 2019-11-27T15:00:27.224 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.224 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-27T15:00:27.224 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-27T15:00:27.228 INFO:tasks.ceph.osd.0:Started 2019-11-27T15:00:27.229 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.229 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-27T15:00:27.229 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-27T15:00:27.233 INFO:tasks.ceph.osd.1:Started 2019-11-27T15:00:27.233 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.233 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-27T15:00:27.234 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-27T15:00:27.238 INFO:tasks.ceph.osd.2:Started 2019-11-27T15:00:27.238 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.238 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-27T15:00:27.238 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-27T15:00:27.242 INFO:tasks.ceph.osd.3:Started 2019-11-27T15:00:27.242 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.242 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-27T15:00:27.242 INFO:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-27T15:00:27.247 INFO:tasks.ceph.osd.4:Started 2019-11-27T15:00:27.247 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.248 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-27T15:00:27.248 INFO:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-27T15:00:27.253 INFO:tasks.ceph.osd.5:Started 2019-11-27T15:00:27.253 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.253 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-27T15:00:27.253 INFO:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-27T15:00:27.257 INFO:tasks.ceph.osd.6:Started 2019-11-27T15:00:27.258 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-27T15:00:27.258 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-27T15:00:27.258 INFO:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-27T15:00:27.262 INFO:tasks.ceph.osd.7:Started 2019-11-27T15:00:27.263 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-27T15:00:28.069 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:29.164 INFO:teuthology.misc.health.smithi156.stdout: 2019-11-27T15:00:29.164 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":10,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:26.966299+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:29.182 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-27T15:00:31.090 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:03.723 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.102 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:03.718 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.135 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:03.748 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.147 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:03.779 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.160 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:03.775 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.194 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:03.807 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.195 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:03.833 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.203 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:03.852 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.241 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:03.852 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.251 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:03.889 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.261 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:03.909 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.279 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:03.884 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.292 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:03.925 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.299 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:03.910 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.337 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:03.942 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.348 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:03.981 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.743 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T15:00:31.722+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T15:00:31.739+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.810 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T15:00:31.788+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.866 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T15:00:31.843+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.871 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T15:00:31.858+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.888 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T15:00:31.870+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.926 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T15:00:31.917+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.931 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T15:00:31.918+0000 9b10800 -1 Falling back to public interface 2019-11-27T15:00:31.962 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:04.595 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:31.981 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:04.596 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.064 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:04.712 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.088 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:04.701 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.108 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:04.746 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.148 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:04.760 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.158 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:04.791 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.179 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:04.784 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.304 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:04.908 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.317 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:04.921 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.383 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:05.015 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.386 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:05.002 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.399 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:05.014 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.407 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:05.039 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.456 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:05.104 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.459 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:05.097 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.469 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:05.117 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.471 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:05.109 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.488 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:05.102 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.500 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:05.113 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.524 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:05.135 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.535 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:05.147 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.557 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:05.190 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:32.574 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:05.207 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:34.913 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:07.545 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:34.921 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:07.553 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.181 INFO:tasks.ceph.osd.0.smithi156.stderr:==00:00:00:07.814 10490== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.265 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:07.869 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.271 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:07.876 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.445 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:08.058 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.452 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:08.065 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.516 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:08.164 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.523 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:08.171 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.534 INFO:tasks.ceph.osd.7.smithi003.stderr:==00:00:00:08.138 9705== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.565 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:08.203 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.572 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:08.210 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.633 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:08.266 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.638 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:08.271 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.713 INFO:tasks.ceph.osd.4.smithi003.stderr:==00:00:00:08.326 9703== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.790 INFO:tasks.ceph.osd.2.smithi156.stderr:==00:00:00:08.438 10487== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.799 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:08.415 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.804 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:08.420 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.836 INFO:tasks.ceph.osd.3.smithi156.stderr:==00:00:00:08.474 10488== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.901 INFO:tasks.ceph.osd.1.smithi156.stderr:==00:00:00:08.534 10489== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:35.987 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:36.064 INFO:tasks.ceph.osd.6.smithi003.stderr:==00:00:00:08.679 9702== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:36.111 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:08.722 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:36.120 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:08.731 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:36.384 INFO:tasks.ceph.osd.5.smithi003.stderr:==00:00:00:08.995 9704== Warning: unimplemented fcntl command: 1038 2019-11-27T15:00:36.510 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T15:00:36.502+0000 9b10800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-27T15:00:36.774 INFO:teuthology.misc.health.smithi156.stdout: 2019-11-27T15:00:36.774 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":10,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:26.966299+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:36.786 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-27T15:00:36.933 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T15:00:36.933+0000 9b10800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-27T15:00:37.282 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T15:00:37.282+0000 9b10800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-27T15:00:37.356 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T15:00:37.356+0000 9b10800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-27T15:00:37.413 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T15:00:37.410+0000 9b10800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-27T15:00:37.440 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T15:00:37.440+0000 9b10800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-27T15:00:37.460 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T15:00:37.459+0000 9b10800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-27T15:00:37.796 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T15:00:37.792+0000 9b10800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-27T15:00:38.411 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T15:00:38.404+0000 2476b700 -1 osd.0 0 waiting for initial osdmap 2019-11-27T15:00:39.581 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T15:00:39.570+0000 2776f700 -1 osd.4 0 waiting for initial osdmap 2019-11-27T15:00:39.583 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T15:00:39.575+0000 2776f700 -1 osd.1 0 waiting for initial osdmap 2019-11-27T15:00:39.583 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T15:00:39.581+0000 2476b700 -1 osd.3 0 waiting for initial osdmap 2019-11-27T15:00:39.604 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T15:00:39.603+0000 27b6f700 -1 osd.7 0 waiting for initial osdmap 2019-11-27T15:00:39.620 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T15:00:39.615+0000 2776f700 -1 osd.6 0 waiting for initial osdmap 2019-11-27T15:00:39.627 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T15:00:39.577+0000 2476b700 -1 osd.2 0 waiting for initial osdmap 2019-11-27T15:00:40.475 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T15:00:40.463+0000 2776f700 -1 osd.5 0 waiting for initial osdmap 2019-11-27T15:00:43.594 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:44.411 INFO:teuthology.misc.health.smithi156.stdout: 2019-11-27T15:00:44.411 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":17,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:43.384001+0000","last_up_change":"2019-11-27T15:00:42.257620+0000","last_in_change":"2019-11-27T15:00:42.257620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":10490},{"type":"v1","addr":"172.21.15.156:6803","nonce":10490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":10490},{"type":"v1","addr":"172.21.15.156:6805","nonce":10490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":10490},{"type":"v1","addr":"172.21.15.156:6809","nonce":10490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":10490},{"type":"v1","addr":"172.21.15.156:6807","nonce":10490}]},"public_addr":"172.21.15.156:6803/10490","cluster_addr":"172.21.15.156:6805/10490","heartbeat_back_addr":"172.21.15.156:6809/10490","heartbeat_front_addr":"172.21.15.156:6807/10490","state":["exists","up"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":10489},{"type":"v1","addr":"172.21.15.156:6825","nonce":10489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":10489},{"type":"v1","addr":"172.21.15.156:6829","nonce":10489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":10489},{"type":"v1","addr":"172.21.15.156:6833","nonce":10489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":10489},{"type":"v1","addr":"172.21.15.156:6831","nonce":10489}]},"public_addr":"172.21.15.156:6825/10489","cluster_addr":"172.21.15.156:6829/10489","heartbeat_back_addr":"172.21.15.156:6833/10489","heartbeat_front_addr":"172.21.15.156:6831/10489","state":["exists","up"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":10487},{"type":"v1","addr":"172.21.15.156:6811","nonce":10487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":10487},{"type":"v1","addr":"172.21.15.156:6813","nonce":10487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":10487},{"type":"v1","addr":"172.21.15.156:6818","nonce":10487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":10487},{"type":"v1","addr":"172.21.15.156:6815","nonce":10487}]},"public_addr":"172.21.15.156:6811/10487","cluster_addr":"172.21.15.156:6813/10487","heartbeat_back_addr":"172.21.15.156:6818/10487","heartbeat_front_addr":"172.21.15.156:6815/10487","state":["exists","up"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":10488},{"type":"v1","addr":"172.21.15.156:6819","nonce":10488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":10488},{"type":"v1","addr":"172.21.15.156:6821","nonce":10488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":10488},{"type":"v1","addr":"172.21.15.156:6828","nonce":10488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":10488},{"type":"v1","addr":"172.21.15.156:6824","nonce":10488}]},"public_addr":"172.21.15.156:6819/10488","cluster_addr":"172.21.15.156:6821/10488","heartbeat_back_addr":"172.21.15.156:6828/10488","heartbeat_front_addr":"172.21.15.156:6824/10488","state":["exists","up"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":9703},{"type":"v1","addr":"172.21.15.3:6809","nonce":9703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":9703},{"type":"v1","addr":"172.21.15.3:6811","nonce":9703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":9703},{"type":"v1","addr":"172.21.15.3:6815","nonce":9703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":9703},{"type":"v1","addr":"172.21.15.3:6813","nonce":9703}]},"public_addr":"172.21.15.3:6809/9703","cluster_addr":"172.21.15.3:6811/9703","heartbeat_back_addr":"172.21.15.3:6815/9703","heartbeat_front_addr":"172.21.15.3:6813/9703","state":["exists","up"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":9704},{"type":"v1","addr":"172.21.15.3:6817","nonce":9704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":9704},{"type":"v1","addr":"172.21.15.3:6819","nonce":9704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":9704},{"type":"v1","addr":"172.21.15.3:6823","nonce":9704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":9704},{"type":"v1","addr":"172.21.15.3:6821","nonce":9704}]},"public_addr":"172.21.15.3:6817/9704","cluster_addr":"172.21.15.3:6819/9704","heartbeat_back_addr":"172.21.15.3:6823/9704","heartbeat_front_addr":"172.21.15.3:6821/9704","state":["exists","up"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":9702},{"type":"v1","addr":"172.21.15.3:6801","nonce":9702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":9702},{"type":"v1","addr":"172.21.15.3:6803","nonce":9702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":9702},{"type":"v1","addr":"172.21.15.3:6807","nonce":9702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":9702},{"type":"v1","addr":"172.21.15.3:6805","nonce":9702}]},"public_addr":"172.21.15.3:6801/9702","cluster_addr":"172.21.15.3:6803/9702","heartbeat_back_addr":"172.21.15.3:6807/9702","heartbeat_front_addr":"172.21.15.3:6805/9702","state":["exists","up"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":9705},{"type":"v1","addr":"172.21.15.3:6825","nonce":9705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":9705},{"type":"v1","addr":"172.21.15.3:6827","nonce":9705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":9705},{"type":"v1","addr":"172.21.15.3:6831","nonce":9705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":9705},{"type":"v1","addr":"172.21.15.3:6829","nonce":9705}]},"public_addr":"172.21.15.3:6825/9705","cluster_addr":"172.21.15.3:6827/9705","heartbeat_back_addr":"172.21.15.3:6831/9705","heartbeat_front_addr":"172.21.15.3:6829/9705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.601858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.549579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.564854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.600477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.400692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:39.010215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.588989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.996802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:44.434 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-27T15:00:44.435 INFO:tasks.ceph:Creating RBD pool 2019-11-27T15:00:44.435 INFO:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-27T15:00:46.169 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'rbd' created 2019-11-27T15:00:50.483 INFO:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-27T15:00:52.351 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-27T15:00:52.368 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-27T15:00:52.368 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:52.369 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-27T15:00:53.338 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:00:53.339 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:52.035579+0000","last_up_change":"2019-11-27T15:00:42.257620+0000","last_in_change":"2019-11-27T15:00:42.257620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T15:00:45.217355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":10490},{"type":"v1","addr":"172.21.15.156:6803","nonce":10490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":10490},{"type":"v1","addr":"172.21.15.156:6805","nonce":10490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":10490},{"type":"v1","addr":"172.21.15.156:6809","nonce":10490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":10490},{"type":"v1","addr":"172.21.15.156:6807","nonce":10490}]},"public_addr":"172.21.15.156:6803/10490","cluster_addr":"172.21.15.156:6805/10490","heartbeat_back_addr":"172.21.15.156:6809/10490","heartbeat_front_addr":"172.21.15.156:6807/10490","state":["exists","up"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":10489},{"type":"v1","addr":"172.21.15.156:6825","nonce":10489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":10489},{"type":"v1","addr":"172.21.15.156:6829","nonce":10489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":10489},{"type":"v1","addr":"172.21.15.156:6833","nonce":10489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":10489},{"type":"v1","addr":"172.21.15.156:6831","nonce":10489}]},"public_addr":"172.21.15.156:6825/10489","cluster_addr":"172.21.15.156:6829/10489","heartbeat_back_addr":"172.21.15.156:6833/10489","heartbeat_front_addr":"172.21.15.156:6831/10489","state":["exists","up"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":10487},{"type":"v1","addr":"172.21.15.156:6811","nonce":10487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":10487},{"type":"v1","addr":"172.21.15.156:6813","nonce":10487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":10487},{"type":"v1","addr":"172.21.15.156:6818","nonce":10487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":10487},{"type":"v1","addr":"172.21.15.156:6815","nonce":10487}]},"public_addr":"172.21.15.156:6811/10487","cluster_addr":"172.21.15.156:6813/10487","heartbeat_back_addr":"172.21.15.156:6818/10487","heartbeat_front_addr":"172.21.15.156:6815/10487","state":["exists","up"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":10488},{"type":"v1","addr":"172.21.15.156:6819","nonce":10488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":10488},{"type":"v1","addr":"172.21.15.156:6821","nonce":10488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":10488},{"type":"v1","addr":"172.21.15.156:6828","nonce":10488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":10488},{"type":"v1","addr":"172.21.15.156:6824","nonce":10488}]},"public_addr":"172.21.15.156:6819/10488","cluster_addr":"172.21.15.156:6821/10488","heartbeat_back_addr":"172.21.15.156:6828/10488","heartbeat_front_addr":"172.21.15.156:6824/10488","state":["exists","up"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":9703},{"type":"v1","addr":"172.21.15.3:6809","nonce":9703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":9703},{"type":"v1","addr":"172.21.15.3:6811","nonce":9703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":9703},{"type":"v1","addr":"172.21.15.3:6815","nonce":9703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":9703},{"type":"v1","addr":"172.21.15.3:6813","nonce":9703}]},"public_addr":"172.21.15.3:6809/9703","cluster_addr":"172.21.15.3:6811/9703","heartbeat_back_addr":"172.21.15.3:6815/9703","heartbeat_front_addr":"172.21.15.3:6813/9703","state":["exists","up"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":9704},{"type":"v1","addr":"172.21.15.3:6817","nonce":9704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":9704},{"type":"v1","addr":"172.21.15.3:6819","nonce":9704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":9704},{"type":"v1","addr":"172.21.15.3:6823","nonce":9704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":9704},{"type":"v1","addr":"172.21.15.3:6821","nonce":9704}]},"public_addr":"172.21.15.3:6817/9704","cluster_addr":"172.21.15.3:6819/9704","heartbeat_back_addr":"172.21.15.3:6823/9704","heartbeat_front_addr":"172.21.15.3:6821/9704","state":["exists","up"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":9702},{"type":"v1","addr":"172.21.15.3:6801","nonce":9702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":9702},{"type":"v1","addr":"172.21.15.3:6803","nonce":9702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":9702},{"type":"v1","addr":"172.21.15.3:6807","nonce":9702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":9702},{"type":"v1","addr":"172.21.15.3:6805","nonce":9702}]},"public_addr":"172.21.15.3:6801/9702","cluster_addr":"172.21.15.3:6803/9702","heartbeat_back_addr":"172.21.15.3:6807/9702","heartbeat_front_addr":"172.21.15.3:6805/9702","state":["exists","up"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":9705},{"type":"v1","addr":"172.21.15.3:6825","nonce":9705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":9705},{"type":"v1","addr":"172.21.15.3:6827","nonce":9705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":9705},{"type":"v1","addr":"172.21.15.3:6831","nonce":9705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":9705},{"type":"v1","addr":"172.21.15.3:6829","nonce":9705}]},"public_addr":"172.21.15.3:6825/9705","cluster_addr":"172.21.15.3:6827/9705","heartbeat_back_addr":"172.21.15.3:6831/9705","heartbeat_front_addr":"172.21.15.3:6829/9705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.601858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.549579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.564854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.600477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.400692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:39.010215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.588989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.996802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:53.355 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-27T15:00:45.217355+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'22', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-27T15:00:53.356 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-27T15:00:54.096 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2019-11-27T15:00:54.114 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-27T15:00:54.114 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-27T15:00:54.114 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-27T15:00:54.965 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:00:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":3,"active_gid":4114,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":9504},{"type":"v1","addr":"172.21.15.156:6801","nonce":9504}]},"active_addr":"172.21.15.156:6801/9504","active_change":"2019-11-27T15:00:05.021953+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-27T15:00:54.987 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-27T15:00:54.988 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-27T15:00:54.988 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:55.715 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:00:55.716 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:52.035579+0000","last_up_change":"2019-11-27T15:00:42.257620+0000","last_in_change":"2019-11-27T15:00:42.257620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T15:00:45.217355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":10490},{"type":"v1","addr":"172.21.15.156:6803","nonce":10490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":10490},{"type":"v1","addr":"172.21.15.156:6805","nonce":10490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":10490},{"type":"v1","addr":"172.21.15.156:6809","nonce":10490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":10490},{"type":"v1","addr":"172.21.15.156:6807","nonce":10490}]},"public_addr":"172.21.15.156:6803/10490","cluster_addr":"172.21.15.156:6805/10490","heartbeat_back_addr":"172.21.15.156:6809/10490","heartbeat_front_addr":"172.21.15.156:6807/10490","state":["exists","up"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":10489},{"type":"v1","addr":"172.21.15.156:6825","nonce":10489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":10489},{"type":"v1","addr":"172.21.15.156:6829","nonce":10489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":10489},{"type":"v1","addr":"172.21.15.156:6833","nonce":10489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":10489},{"type":"v1","addr":"172.21.15.156:6831","nonce":10489}]},"public_addr":"172.21.15.156:6825/10489","cluster_addr":"172.21.15.156:6829/10489","heartbeat_back_addr":"172.21.15.156:6833/10489","heartbeat_front_addr":"172.21.15.156:6831/10489","state":["exists","up"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":10487},{"type":"v1","addr":"172.21.15.156:6811","nonce":10487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":10487},{"type":"v1","addr":"172.21.15.156:6813","nonce":10487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":10487},{"type":"v1","addr":"172.21.15.156:6818","nonce":10487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":10487},{"type":"v1","addr":"172.21.15.156:6815","nonce":10487}]},"public_addr":"172.21.15.156:6811/10487","cluster_addr":"172.21.15.156:6813/10487","heartbeat_back_addr":"172.21.15.156:6818/10487","heartbeat_front_addr":"172.21.15.156:6815/10487","state":["exists","up"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":10488},{"type":"v1","addr":"172.21.15.156:6819","nonce":10488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":10488},{"type":"v1","addr":"172.21.15.156:6821","nonce":10488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":10488},{"type":"v1","addr":"172.21.15.156:6828","nonce":10488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":10488},{"type":"v1","addr":"172.21.15.156:6824","nonce":10488}]},"public_addr":"172.21.15.156:6819/10488","cluster_addr":"172.21.15.156:6821/10488","heartbeat_back_addr":"172.21.15.156:6828/10488","heartbeat_front_addr":"172.21.15.156:6824/10488","state":["exists","up"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":9703},{"type":"v1","addr":"172.21.15.3:6809","nonce":9703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":9703},{"type":"v1","addr":"172.21.15.3:6811","nonce":9703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":9703},{"type":"v1","addr":"172.21.15.3:6815","nonce":9703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":9703},{"type":"v1","addr":"172.21.15.3:6813","nonce":9703}]},"public_addr":"172.21.15.3:6809/9703","cluster_addr":"172.21.15.3:6811/9703","heartbeat_back_addr":"172.21.15.3:6815/9703","heartbeat_front_addr":"172.21.15.3:6813/9703","state":["exists","up"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":9704},{"type":"v1","addr":"172.21.15.3:6817","nonce":9704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":9704},{"type":"v1","addr":"172.21.15.3:6819","nonce":9704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":9704},{"type":"v1","addr":"172.21.15.3:6823","nonce":9704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":9704},{"type":"v1","addr":"172.21.15.3:6821","nonce":9704}]},"public_addr":"172.21.15.3:6817/9704","cluster_addr":"172.21.15.3:6819/9704","heartbeat_back_addr":"172.21.15.3:6823/9704","heartbeat_front_addr":"172.21.15.3:6821/9704","state":["exists","up"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":9702},{"type":"v1","addr":"172.21.15.3:6801","nonce":9702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":9702},{"type":"v1","addr":"172.21.15.3:6803","nonce":9702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":9702},{"type":"v1","addr":"172.21.15.3:6807","nonce":9702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":9702},{"type":"v1","addr":"172.21.15.3:6805","nonce":9702}]},"public_addr":"172.21.15.3:6801/9702","cluster_addr":"172.21.15.3:6803/9702","heartbeat_back_addr":"172.21.15.3:6807/9702","heartbeat_front_addr":"172.21.15.3:6805/9702","state":["exists","up"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":9705},{"type":"v1","addr":"172.21.15.3:6825","nonce":9705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":9705},{"type":"v1","addr":"172.21.15.3:6827","nonce":9705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":9705},{"type":"v1","addr":"172.21.15.3:6831","nonce":9705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":9705},{"type":"v1","addr":"172.21.15.3:6829","nonce":9705}]},"public_addr":"172.21.15.3:6825/9705","cluster_addr":"172.21.15.3:6827/9705","heartbeat_back_addr":"172.21.15.3:6831/9705","heartbeat_front_addr":"172.21.15.3:6829/9705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.601858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.549579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.564854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.600477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.400692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:39.010215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.588989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.996802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:55.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-27T15:00:55.732 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-27T15:00:56.484 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:00:56.485 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"d4e77d13-5c26-488a-bbfb-ae1f2ac96e57","created":"2019-11-27T15:00:00.936885+0000","modified":"2019-11-27T15:00:52.035579+0000","last_up_change":"2019-11-27T15:00:42.257620+0000","last_in_change":"2019-11-27T15:00:42.257620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-27T15:00:45.217355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54884f34-334e-4aa9-b2fa-a2c4642a6dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":10490},{"type":"v1","addr":"172.21.15.156:6803","nonce":10490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":10490},{"type":"v1","addr":"172.21.15.156:6805","nonce":10490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":10490},{"type":"v1","addr":"172.21.15.156:6809","nonce":10490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":10490},{"type":"v1","addr":"172.21.15.156:6807","nonce":10490}]},"public_addr":"172.21.15.156:6803/10490","cluster_addr":"172.21.15.156:6805/10490","heartbeat_back_addr":"172.21.15.156:6809/10490","heartbeat_front_addr":"172.21.15.156:6807/10490","state":["exists","up"]},{"osd":1,"uuid":"5b775534-72f8-4480-ac8d-8f986ab68626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":10489},{"type":"v1","addr":"172.21.15.156:6825","nonce":10489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":10489},{"type":"v1","addr":"172.21.15.156:6829","nonce":10489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":10489},{"type":"v1","addr":"172.21.15.156:6833","nonce":10489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":10489},{"type":"v1","addr":"172.21.15.156:6831","nonce":10489}]},"public_addr":"172.21.15.156:6825/10489","cluster_addr":"172.21.15.156:6829/10489","heartbeat_back_addr":"172.21.15.156:6833/10489","heartbeat_front_addr":"172.21.15.156:6831/10489","state":["exists","up"]},{"osd":2,"uuid":"4df6eef7-9be7-4302-919f-dff355ef6f1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":10487},{"type":"v1","addr":"172.21.15.156:6811","nonce":10487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":10487},{"type":"v1","addr":"172.21.15.156:6813","nonce":10487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":10487},{"type":"v1","addr":"172.21.15.156:6818","nonce":10487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":10487},{"type":"v1","addr":"172.21.15.156:6815","nonce":10487}]},"public_addr":"172.21.15.156:6811/10487","cluster_addr":"172.21.15.156:6813/10487","heartbeat_back_addr":"172.21.15.156:6818/10487","heartbeat_front_addr":"172.21.15.156:6815/10487","state":["exists","up"]},{"osd":3,"uuid":"826ec1e8-366e-4164-9642-2fd447e85368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":10488},{"type":"v1","addr":"172.21.15.156:6819","nonce":10488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":10488},{"type":"v1","addr":"172.21.15.156:6821","nonce":10488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":10488},{"type":"v1","addr":"172.21.15.156:6828","nonce":10488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":10488},{"type":"v1","addr":"172.21.15.156:6824","nonce":10488}]},"public_addr":"172.21.15.156:6819/10488","cluster_addr":"172.21.15.156:6821/10488","heartbeat_back_addr":"172.21.15.156:6828/10488","heartbeat_front_addr":"172.21.15.156:6824/10488","state":["exists","up"]},{"osd":4,"uuid":"0a9a2eee-57ca-4b1f-a99e-07030c4f8b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":9703},{"type":"v1","addr":"172.21.15.3:6809","nonce":9703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":9703},{"type":"v1","addr":"172.21.15.3:6811","nonce":9703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":9703},{"type":"v1","addr":"172.21.15.3:6815","nonce":9703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":9703},{"type":"v1","addr":"172.21.15.3:6813","nonce":9703}]},"public_addr":"172.21.15.3:6809/9703","cluster_addr":"172.21.15.3:6811/9703","heartbeat_back_addr":"172.21.15.3:6815/9703","heartbeat_front_addr":"172.21.15.3:6813/9703","state":["exists","up"]},{"osd":5,"uuid":"9a2713bd-0ac7-458c-a524-a0212b248e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":9704},{"type":"v1","addr":"172.21.15.3:6817","nonce":9704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":9704},{"type":"v1","addr":"172.21.15.3:6819","nonce":9704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":9704},{"type":"v1","addr":"172.21.15.3:6823","nonce":9704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":9704},{"type":"v1","addr":"172.21.15.3:6821","nonce":9704}]},"public_addr":"172.21.15.3:6817/9704","cluster_addr":"172.21.15.3:6819/9704","heartbeat_back_addr":"172.21.15.3:6823/9704","heartbeat_front_addr":"172.21.15.3:6821/9704","state":["exists","up"]},{"osd":6,"uuid":"e71fe26e-da94-4d8b-9ce1-e9b53ffd7733","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":9702},{"type":"v1","addr":"172.21.15.3:6801","nonce":9702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":9702},{"type":"v1","addr":"172.21.15.3:6803","nonce":9702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":9702},{"type":"v1","addr":"172.21.15.3:6807","nonce":9702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":9702},{"type":"v1","addr":"172.21.15.3:6805","nonce":9702}]},"public_addr":"172.21.15.3:6801/9702","cluster_addr":"172.21.15.3:6803/9702","heartbeat_back_addr":"172.21.15.3:6807/9702","heartbeat_front_addr":"172.21.15.3:6805/9702","state":["exists","up"]},{"osd":7,"uuid":"d44e20aa-a520-40bb-91ab-3b81fbdb847a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":9705},{"type":"v1","addr":"172.21.15.3:6825","nonce":9705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":9705},{"type":"v1","addr":"172.21.15.3:6827","nonce":9705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":9705},{"type":"v1","addr":"172.21.15.3:6831","nonce":9705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":9705},{"type":"v1","addr":"172.21.15.3:6829","nonce":9705}]},"public_addr":"172.21.15.3:6825/9705","cluster_addr":"172.21.15.3:6827/9705","heartbeat_back_addr":"172.21.15.3:6831/9705","heartbeat_front_addr":"172.21.15.3:6829/9705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.601858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.549579+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.564854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.600477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.400692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:39.010215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:38.588989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-27T15:00:37.996802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-27T15:00:56.506 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-27T15:00:57.024 INFO:teuthology.orchestra.run.smithi156.stdout:60129542151 2019-11-27T15:00:57.025 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-27T15:00:57.479 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:00:57.479 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-27T15:00:58.020 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:00:58.020 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-27T15:00:58.542 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:00:58.543 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-27T15:00:59.243 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:00:59.244 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-27T15:00:59.763 INFO:teuthology.orchestra.run.smithi156.stdout:68719476744 2019-11-27T15:00:59.763 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-27T15:01:00.337 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:01:00.337 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-27T15:01:00.889 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:01:00.889 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-27T15:01:01.677 INFO:teuthology.orchestra.run.smithi156.stdout:60129542152 2019-11-27T15:01:01.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.0 2019-11-27T15:01:01.690 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-27T15:01:02.403 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:01:02.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2019-11-27T15:01:02.417 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-27T15:01:03.142 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:01:03.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2019-11-27T15:01:03.156 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-27T15:01:03.943 INFO:teuthology.orchestra.run.smithi156.stdout:64424509447 2019-11-27T15:01:03.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2019-11-27T15:01:03.962 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-27T15:01:04.671 INFO:teuthology.orchestra.run.smithi156.stdout:64424509448 2019-11-27T15:01:04.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.4 2019-11-27T15:01:04.689 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-27T15:01:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:68719476744 2019-11-27T15:01:05.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.5 2019-11-27T15:01:05.412 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-27T15:01:06.125 INFO:teuthology.orchestra.run.smithi156.stdout:64424509448 2019-11-27T15:01:06.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2019-11-27T15:01:06.138 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-27T15:01:06.855 INFO:teuthology.orchestra.run.smithi156.stdout:64424509448 2019-11-27T15:01:06.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2019-11-27T15:01:06.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-27T15:01:06.873 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-27T15:01:07.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:01:07.646 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2019-11-27T15:01:07.658 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2019-11-27T15:01:07.334437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390400,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584320,"statfs":{"total":773094113280,"available":764502343680,"internally_reserved":8589934592,"allocated":1769472,"data_stored":570160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.500237+0000","last_change":"2019-11-27T15:00:47.911947+0000","last_active":"2019-11-27T15:00:50.500237+0000","last_peered":"2019-11-27T15:00:50.500237+0000","last_clean":"2019-11-27T15:00:50.500237+0000","last_became_active":"2019-11-27T15:00:47.879135+0000","last_became_peered":"2019-11-27T15:00:47.879135+0000","last_unstale":"2019-11-27T15:00:50.500237+0000","last_undegraded":"2019-11-27T15:00:50.500237+0000","last_fullsized":"2019-11-27T15:00:50.500237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.495344+0000","last_change":"2019-11-27T15:00:48.071803+0000","last_active":"2019-11-27T15:00:50.495344+0000","last_peered":"2019-11-27T15:00:50.495344+0000","last_clean":"2019-11-27T15:00:50.495344+0000","last_became_active":"2019-11-27T15:00:48.053296+0000","last_became_peered":"2019-11-27T15:00:48.053296+0000","last_unstale":"2019-11-27T15:00:50.495344+0000","last_undegraded":"2019-11-27T15:00:50.495344+0000","last_fullsized":"2019-11-27T15:00:50.495344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.502239+0000","last_change":"2019-11-27T15:00:48.945925+0000","last_active":"2019-11-27T15:00:50.502239+0000","last_peered":"2019-11-27T15:00:50.502239+0000","last_clean":"2019-11-27T15:00:50.502239+0000","last_became_active":"2019-11-27T15:00:48.907609+0000","last_became_peered":"2019-11-27T15:00:48.907609+0000","last_unstale":"2019-11-27T15:00:50.502239+0000","last_undegraded":"2019-11-27T15:00:50.502239+0000","last_fullsized":"2019-11-27T15:00:50.502239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.473426+0000","last_change":"2019-11-27T15:00:48.761531+0000","last_active":"2019-11-27T15:00:50.473426+0000","last_peered":"2019-11-27T15:00:50.473426+0000","last_clean":"2019-11-27T15:00:50.473426+0000","last_became_active":"2019-11-27T15:00:48.724669+0000","last_became_peered":"2019-11-27T15:00:48.724669+0000","last_unstale":"2019-11-27T15:00:50.473426+0000","last_undegraded":"2019-11-27T15:00:50.473426+0000","last_fullsized":"2019-11-27T15:00:50.473426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.851029+0000","last_change":"2019-11-27T15:00:48.884025+0000","last_active":"2019-11-27T15:00:49.851029+0000","last_peered":"2019-11-27T15:00:49.851029+0000","last_clean":"2019-11-27T15:00:49.851029+0000","last_became_active":"2019-11-27T15:00:48.839376+0000","last_became_peered":"2019-11-27T15:00:48.839376+0000","last_unstale":"2019-11-27T15:00:49.851029+0000","last_undegraded":"2019-11-27T15:00:49.851029+0000","last_fullsized":"2019-11-27T15:00:49.851029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.511748+0000","last_change":"2019-11-27T15:00:48.871748+0000","last_active":"2019-11-27T15:00:50.511748+0000","last_peered":"2019-11-27T15:00:50.511748+0000","last_clean":"2019-11-27T15:00:50.511748+0000","last_became_active":"2019-11-27T15:00:48.831955+0000","last_became_peered":"2019-11-27T15:00:48.831955+0000","last_unstale":"2019-11-27T15:00:50.511748+0000","last_undegraded":"2019-11-27T15:00:50.511748+0000","last_fullsized":"2019-11-27T15:00:50.511748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.856473+0000","last_change":"2019-11-27T15:00:48.931422+0000","last_active":"2019-11-27T15:00:49.856473+0000","last_peered":"2019-11-27T15:00:49.856473+0000","last_clean":"2019-11-27T15:00:49.856473+0000","last_became_active":"2019-11-27T15:00:48.910529+0000","last_became_peered":"2019-11-27T15:00:48.910529+0000","last_unstale":"2019-11-27T15:00:49.856473+0000","last_undegraded":"2019-11-27T15:00:49.856473+0000","last_fullsized":"2019-11-27T15:00:49.856473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.879452+0000","last_change":"2019-11-27T15:00:47.726773+0000","last_active":"2019-11-27T15:00:49.879452+0000","last_peered":"2019-11-27T15:00:49.879452+0000","last_clean":"2019-11-27T15:00:49.879452+0000","last_became_active":"2019-11-27T15:00:47.677276+0000","last_became_peered":"2019-11-27T15:00:47.677276+0000","last_unstale":"2019-11-27T15:00:49.879452+0000","last_undegraded":"2019-11-27T15:00:49.879452+0000","last_fullsized":"2019-11-27T15:00:49.879452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.076}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.064}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.588}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.164}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.474}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.560}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.945}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.635}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.253}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.114}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.062}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.969}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.952}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.731}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.090}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":48.481}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.407}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.346}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.402}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.898}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.640}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.480}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.473}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.660}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.396}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.288}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.186}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.654}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":9.279}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.338}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.696}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.104}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.970}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.797}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":5.836}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.681}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.451}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.150}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.561}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.825}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.065}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.774}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.636}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.650}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.426}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.809}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.232}]}]}]}} 2019-11-27T15:01:07.661 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-27T15:01:08.430 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:01:08.431 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2019-11-27T15:01:08.443 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2019-11-27T15:01:07.334437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390400,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584320,"statfs":{"total":773094113280,"available":764502343680,"internally_reserved":8589934592,"allocated":1769472,"data_stored":570160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.500237+0000","last_change":"2019-11-27T15:00:47.911947+0000","last_active":"2019-11-27T15:00:50.500237+0000","last_peered":"2019-11-27T15:00:50.500237+0000","last_clean":"2019-11-27T15:00:50.500237+0000","last_became_active":"2019-11-27T15:00:47.879135+0000","last_became_peered":"2019-11-27T15:00:47.879135+0000","last_unstale":"2019-11-27T15:00:50.500237+0000","last_undegraded":"2019-11-27T15:00:50.500237+0000","last_fullsized":"2019-11-27T15:00:50.500237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.495344+0000","last_change":"2019-11-27T15:00:48.071803+0000","last_active":"2019-11-27T15:00:50.495344+0000","last_peered":"2019-11-27T15:00:50.495344+0000","last_clean":"2019-11-27T15:00:50.495344+0000","last_became_active":"2019-11-27T15:00:48.053296+0000","last_became_peered":"2019-11-27T15:00:48.053296+0000","last_unstale":"2019-11-27T15:00:50.495344+0000","last_undegraded":"2019-11-27T15:00:50.495344+0000","last_fullsized":"2019-11-27T15:00:50.495344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.502239+0000","last_change":"2019-11-27T15:00:48.945925+0000","last_active":"2019-11-27T15:00:50.502239+0000","last_peered":"2019-11-27T15:00:50.502239+0000","last_clean":"2019-11-27T15:00:50.502239+0000","last_became_active":"2019-11-27T15:00:48.907609+0000","last_became_peered":"2019-11-27T15:00:48.907609+0000","last_unstale":"2019-11-27T15:00:50.502239+0000","last_undegraded":"2019-11-27T15:00:50.502239+0000","last_fullsized":"2019-11-27T15:00:50.502239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.473426+0000","last_change":"2019-11-27T15:00:48.761531+0000","last_active":"2019-11-27T15:00:50.473426+0000","last_peered":"2019-11-27T15:00:50.473426+0000","last_clean":"2019-11-27T15:00:50.473426+0000","last_became_active":"2019-11-27T15:00:48.724669+0000","last_became_peered":"2019-11-27T15:00:48.724669+0000","last_unstale":"2019-11-27T15:00:50.473426+0000","last_undegraded":"2019-11-27T15:00:50.473426+0000","last_fullsized":"2019-11-27T15:00:50.473426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.851029+0000","last_change":"2019-11-27T15:00:48.884025+0000","last_active":"2019-11-27T15:00:49.851029+0000","last_peered":"2019-11-27T15:00:49.851029+0000","last_clean":"2019-11-27T15:00:49.851029+0000","last_became_active":"2019-11-27T15:00:48.839376+0000","last_became_peered":"2019-11-27T15:00:48.839376+0000","last_unstale":"2019-11-27T15:00:49.851029+0000","last_undegraded":"2019-11-27T15:00:49.851029+0000","last_fullsized":"2019-11-27T15:00:49.851029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:50.511748+0000","last_change":"2019-11-27T15:00:48.871748+0000","last_active":"2019-11-27T15:00:50.511748+0000","last_peered":"2019-11-27T15:00:50.511748+0000","last_clean":"2019-11-27T15:00:50.511748+0000","last_became_active":"2019-11-27T15:00:48.831955+0000","last_became_peered":"2019-11-27T15:00:48.831955+0000","last_unstale":"2019-11-27T15:00:50.511748+0000","last_undegraded":"2019-11-27T15:00:50.511748+0000","last_fullsized":"2019-11-27T15:00:50.511748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.856473+0000","last_change":"2019-11-27T15:00:48.931422+0000","last_active":"2019-11-27T15:00:49.856473+0000","last_peered":"2019-11-27T15:00:49.856473+0000","last_clean":"2019-11-27T15:00:49.856473+0000","last_became_active":"2019-11-27T15:00:48.910529+0000","last_became_peered":"2019-11-27T15:00:48.910529+0000","last_unstale":"2019-11-27T15:00:49.856473+0000","last_undegraded":"2019-11-27T15:00:49.856473+0000","last_fullsized":"2019-11-27T15:00:49.856473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-11-27T15:00:49.879452+0000","last_change":"2019-11-27T15:00:47.726773+0000","last_active":"2019-11-27T15:00:49.879452+0000","last_peered":"2019-11-27T15:00:49.879452+0000","last_clean":"2019-11-27T15:00:49.879452+0000","last_became_active":"2019-11-27T15:00:47.677276+0000","last_became_peered":"2019-11-27T15:00:47.677276+0000","last_unstale":"2019-11-27T15:00:49.879452+0000","last_undegraded":"2019-11-27T15:00:49.879452+0000","last_fullsized":"2019-11-27T15:00:49.879452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-27T15:00:45.581910+0000","last_clean_scrub_stamp":"2019-11-27T15:00:45.581910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.076}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.064}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.588}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.164}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.474}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.560}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.945}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.635}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.253}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.114}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.062}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.969}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.952}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.731}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.090}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":48.481}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.407}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.346}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.402}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.898}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.640}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.480}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.473}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.660}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.396}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.288}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.186}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.654}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":9.279}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.338}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.696}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.104}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.970}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.797}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":5.836}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.681}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.451}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.150}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.561}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.825}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.065}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":71270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.774}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.636}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.650}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.426}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.809}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.232}]}]}]}} 2019-11-27T15:01:08.446 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-27T15:01:08.446 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-27T15:01:08.446 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-27T15:01:08.446 INFO:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-27T15:01:09.242 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:01:09.258 INFO:teuthology.orchestra.run.smithi156.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-27T15:01:09.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-27T15:01:09.819 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-27T15:01:09.870 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2019-11-27T15:01:09.870 INFO:teuthology.orchestra.run.smithi156:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-27T15:01:09.961 INFO:teuthology.orchestra.run.smithi156:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2019-11-27T15:01:10.046 INFO:teuthology.orchestra.run.smithi156.stderr:Generating a 4096 bit RSA private key 2019-11-27T15:01:10.407 INFO:teuthology.orchestra.run.smithi156.stderr:.....................................................................................................++ 2019-11-27T15:01:10.532 INFO:teuthology.orchestra.run.smithi156.stderr:......................................++ 2019-11-27T15:01:10.533 INFO:teuthology.orchestra.run.smithi156.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2019-11-27T15:01:10.533 INFO:teuthology.orchestra.run.smithi156.stderr:----- 2019-11-27T15:01:10.539 INFO:teuthology.orchestra.run.smithi156:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-11-27T15:01:10.636 INFO:teuthology.orchestra.run.smithi156:> sudo update-ca-trust 2019-11-27T15:01:11.301 INFO:teuthology.orchestra.run.smithi003:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-27T15:01:11.407 INFO:tasks.openssl_keys:copying from ubuntu@smithi156.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi003.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2019-11-27T15:01:11.506 DEBUG:teuthology.orchestra.remote:smithi156:/home/ubuntu/cephtest/ca/root.crt is 2KB 2019-11-27T15:01:11.688 INFO:teuthology.orchestra.run.smithi003:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-11-27T15:01:11.797 INFO:teuthology.orchestra.run.smithi003:> sudo update-ca-trust 2019-11-27T15:01:12.495 INFO:teuthology.orchestra.run.smithi003:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-27T15:01:12.565 INFO:teuthology.orchestra.run.smithi156:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi003.front.sepia.ceph.com 2019-11-27T15:01:12.659 INFO:teuthology.orchestra.run.smithi156.stderr:Generating a 2048 bit RSA private key 2019-11-27T15:01:12.694 INFO:teuthology.orchestra.run.smithi156.stderr:..................+++ 2019-11-27T15:01:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:.+++ 2019-11-27T15:01:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2019-11-27T15:01:12.698 INFO:teuthology.orchestra.run.smithi156.stderr:----- 2019-11-27T15:01:12.700 INFO:teuthology.orchestra.run.smithi156:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2019-11-27T15:01:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:Signature ok 2019-11-27T15:01:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:subject=/CN=smithi003.front.sepia.ceph.com 2019-11-27T15:01:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:Getting CA Private Key 2019-11-27T15:01:12.787 INFO:teuthology.orchestra.run.smithi156:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2019-11-27T15:01:12.859 INFO:teuthology.orchestra.run.smithi156:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-27T15:01:12.925 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-11-27T15:01:12.925 INFO:tasks.openssl_keys:copying from ubuntu@smithi156.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi003.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2019-11-27T15:01:12.984 DEBUG:teuthology.orchestra.remote:smithi156:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2019-11-27T15:01:13.131 INFO:tasks.openssl_keys:copying from ubuntu@smithi156.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi003.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2019-11-27T15:01:13.208 DEBUG:teuthology.orchestra.remote:smithi156:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2019-11-27T15:01:13.350 INFO:teuthology.orchestra.run.smithi156:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2019-11-27T15:01:13.407 INFO:teuthology.orchestra.run.smithi003:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-27T15:01:13.519 INFO:teuthology.orchestra.run.smithi003.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-11-27T15:01:13.520 INFO:teuthology.orchestra.run.smithi003:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-27T15:01:13.627 INFO:teuthology.orchestra.run.smithi156:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-27T15:01:13.715 INFO:teuthology.orchestra.run.smithi156:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi156.front.sepia.ceph.com 2019-11-27T15:01:13.807 INFO:teuthology.orchestra.run.smithi156.stderr:Generating a 2048 bit RSA private key 2019-11-27T15:01:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:.........................................+++ 2019-11-27T15:01:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:.........................+++ 2019-11-27T15:01:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2019-11-27T15:01:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:----- 2019-11-27T15:01:13.919 INFO:teuthology.orchestra.run.smithi156:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2019-11-27T15:01:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:Signature ok 2019-11-27T15:01:13.994 INFO:teuthology.orchestra.run.smithi156.stderr:subject=/CN=smithi156.front.sepia.ceph.com 2019-11-27T15:01:13.994 INFO:teuthology.orchestra.run.smithi156.stderr:Getting CA Private Key 2019-11-27T15:01:14.005 INFO:teuthology.orchestra.run.smithi156:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2019-11-27T15:01:14.068 INFO:teuthology.orchestra.run.smithi156:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-11-27T15:01:14.138 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2019-11-27T15:01:14.138 INFO:teuthology.orchestra.run.smithi156:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-11-27T15:01:14.193 INFO:teuthology.run_tasks:Running task rgw... 2019-11-27T15:01:14.439 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-27T15:01:14.439 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-27T15:01:14.439 INFO:tasks.rgw:Creating data pools 2019-11-27T15:01:14.439 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-27T15:01:14.440 INFO:teuthology.orchestra.run.smithi156:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2019-11-27T15:01:15.714 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'default.rgw.buckets.data' created 2019-11-27T15:01:15.730 INFO:teuthology.orchestra.run.smithi156:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-27T15:01:17.054 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-27T15:01:17.068 INFO:teuthology.orchestra.run.smithi156:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-27T15:01:18.313 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'default.rgw.buckets.index' created 2019-11-27T15:01:18.326 INFO:teuthology.orchestra.run.smithi156:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-27T15:01:19.551 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-27T15:01:19.566 DEBUG:tasks.rgw:Pools created 2019-11-27T15:01:19.567 INFO:tasks.rgw:Configuring compression type = random 2019-11-27T15:01:19.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-27T15:01:19.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-27T15:01:19.567 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-27T15:01:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:19.720+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:22.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.201+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:22.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.201+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.300+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.300+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:22.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.307+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:22.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.307+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:22.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:22.311+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.938+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:23.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.947+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.947+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:23.952 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.955+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.952 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.955+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:23.962 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.965+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.962 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.965+0000 7f4866078ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:01:23.963 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.965+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:23.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.974+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.974+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:23.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.982+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:23.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.982+0000 7f4866078ec0 10 Creating default zonegroup 2019-11-27T15:01:23.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:23.982+0000 7f4866078ec0 20 get_system_obj_state: rctx=0x7ffe47a54fb0 obj=:.pools.avail state=0x558587d04fd0 s->prefetch_data=0 2019-11-27T15:01:24.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:24.043+0000 7f4866078ec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-27T15:01:24.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:24.249+0000 7f4866078ec0 10 WARNING: store->list_zones() returned r=-2 2019-11-27T15:01:24.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:24.249+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:24.259+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:25.293 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.296+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.304+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:25.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.304+0000 7f4866078ec0 10 could not read realm id: (2) No such file or directory 2019-11-27T15:01:25.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.304+0000 7f4866078ec0 10 WARNING: failed to set zone as default, r=-22 2019-11-27T15:01:25.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.304+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.312+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:25.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.586+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.635+0000 7f4866078ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T15:01:25.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.635+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.649+0000 7f4866078ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T15:01:25.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.649+0000 7f4866078ec0 20 zonegroup default 2019-11-27T15:01:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.649+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.658+0000 7f4866078ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:25.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.658+0000 7f4866078ec0 10 Cannot find current period zone using local zone 2019-11-27T15:01:25.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.658+0000 7f4866078ec0 10 Using default name default 2019-11-27T15:01:25.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.658+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.708+0000 7f4866078ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:25.706 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.709+0000 7f4866078ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:25.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.733+0000 7f48532a5700 0 -- 172.21.15.156:0/1648636815 >> [v2:172.21.15.3:6808/9703,v1:172.21.15.3:6809/9703] conn(0x7f484c0043c0 msgr2=0x7f484c0047d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:01:25.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.733+0000 7f4866078ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T15:01:25.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.733+0000 7f4866078ec0 20 zone default found 2019-11-27T15:01:25.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.733+0000 7f4866078ec0 20 started sync module instance, tier type = 2019-11-27T15:01:25.731 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:25.733+0000 7f4866078ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:01:29.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:29.721+0000 7f4852aa4700 0 -- 172.21.15.156:0/1648636815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558587ce7e10 msgr2=0x558587cee830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T15:01:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=0 2019-11-27T15:01:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=1 2019-11-27T15:01:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=2 2019-11-27T15:01:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=3 2019-11-27T15:01:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=4 2019-11-27T15:01:30.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.867+0000 7f4866078ec0 20 add_watcher() i=5 2019-11-27T15:01:30.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.878+0000 7f4866078ec0 20 add_watcher() i=6 2019-11-27T15:01:30.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.961+0000 7f4866078ec0 20 add_watcher() i=7 2019-11-27T15:01:30.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.961+0000 7f4866078ec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:01:30.959 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:30.962+0000 7f4823fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:01:34.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:34.733+0000 7f4866078ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-27T15:01:39.146 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:39.149+0000 7f4866078ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-27T15:01:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:43.502+0000 7f478a7fc700 20 reqs_thread_entry: start 2019-11-27T15:01:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:43.502+0000 7f477bfff700 20 reqs_thread_entry: start 2019-11-27T15:01:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:43.502+0000 7f4866078ec0 20 init_complete bucket index max shards: 0 2019-11-27T15:01:43.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:43.503+0000 7f477a7fc700 20 reqs_thread_entry: start 2019-11-27T15:01:44.031 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.034+0000 7f4866078ec0 20 remove_watcher() i=0 2019-11-27T15:01:44.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.034+0000 7f4866078ec0 2 removed watcher, disabling cache 2019-11-27T15:01:44.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.111+0000 7f4866078ec0 20 remove_watcher() i=1 2019-11-27T15:01:44.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.163+0000 7f4866078ec0 20 remove_watcher() i=2 2019-11-27T15:01:44.261 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.264+0000 7f4866078ec0 20 remove_watcher() i=3 2019-11-27T15:01:44.366 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.369+0000 7f4866078ec0 20 remove_watcher() i=4 2019-11-27T15:01:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.427+0000 7f4866078ec0 20 remove_watcher() i=5 2019-11-27T15:01:44.495 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.498+0000 7f4866078ec0 20 remove_watcher() i=6 2019-11-27T15:01:44.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.553+0000 7f4866078ec0 20 remove_watcher() i=7 2019-11-27T15:01:44.559 INFO:teuthology.orchestra.run.smithi156.stdout:[] 2019-11-27T15:01:44.559 DEBUG:tasks.util.rgw: json result: [] 2019-11-27T15:01:44.559 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-27T15:01:44.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-27T15:01:44.560 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-27T15:01:44.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.804+0000 7fe477fff700 20 reqs_thread_entry: start 2019-11-27T15:01:44.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.804+0000 7fe5434bdec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:44.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.821+0000 7fe5434bdec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:44.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.821+0000 7fe5434bdec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:44.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.846+0000 7fe5434bdec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-27T15:01:44.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.846+0000 7fe5434bdec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:44.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.854+0000 7fe5434bdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:44.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.854+0000 7fe5434bdec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.868+0000 7fe5434bdec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.868+0000 7fe5434bdec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:44.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:44.882+0000 7fe5434bdec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T15:01:45.099 INFO:teuthology.orchestra.run.smithi156.stdout:{"id":"52e9f6d5-9017-4df2-9490-35fe7d8cf870","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T15:01:45.100 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'52e9f6d5-9017-4df2-9490-35fe7d8cf870', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T15:01:45.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-27T15:01:45.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-27T15:01:45.100 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-27T15:01:45.249 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.252+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.280+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.280+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.289+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.289+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.295+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.295+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.300 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.304+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.544+0000 7f08b46c3ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:01:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.544+0000 7f08b46c3ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:01:45.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.544+0000 7f08b46c3ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:01:45.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.544+0000 7f08b46c3ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:01:45.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.544+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.556+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:45.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.557+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.575+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T15:01:45.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.575+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.590+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:45.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.590+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.601 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.604+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T15:01:45.601 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.604+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.610+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.610+0000 7f08b46c3ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:01:45.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.610+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.616+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.616+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.623 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.626+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:45.623 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.626+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.644+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T15:01:45.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.644+0000 7f08b46c3ec0 20 zonegroup default 2019-11-27T15:01:45.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.644+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.650+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.650+0000 7f08b46c3ec0 10 Cannot find current period zone using local zone 2019-11-27T15:01:45.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.650+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.657+0000 7f08b46c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:45.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.657+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.671+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.671+0000 7f08b46c3ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.689+0000 7f08b46c3ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T15:01:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.689+0000 7f08b46c3ec0 20 zone default found 2019-11-27T15:01:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.689+0000 7f08b46c3ec0 20 started sync module instance, tier type = 2019-11-27T15:01:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:45.689+0000 7f08b46c3ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:01:46.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=0 2019-11-27T15:01:46.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=1 2019-11-27T15:01:46.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=2 2019-11-27T15:01:46.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=3 2019-11-27T15:01:46.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=4 2019-11-27T15:01:46.169 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08b46c3ec0 20 add_watcher() i=5 2019-11-27T15:01:46.169 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.171+0000 7f08a18f0700 0 -- 172.21.15.156:0/657232245 >> [v2:172.21.15.3:6824/9705,v1:172.21.15.3:6825/9705] conn(0x559140092560 msgr2=0x5591400949c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T15:01:46.392 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.395+0000 7f08b46c3ec0 20 add_watcher() i=6 2019-11-27T15:01:46.392 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.395+0000 7f08b46c3ec0 20 add_watcher() i=7 2019-11-27T15:01:46.393 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.395+0000 7f08b46c3ec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:01:46.393 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.396+0000 7f08727dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:01:46.430 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.433+0000 7f08a18f0700 0 -- 172.21.15.156:0/3727352765 >> v2:172.21.15.156:3300/0 conn(0x5591400a9630 msgr2=0x5591400aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T15:01:46.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:46.635+0000 7f08a18f0700 0 --2- 172.21.15.156:0/3727352765 >> v2:172.21.15.156:3300/0 conn(0x5591400a9630 0x5591400aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T15:01:49.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.143+0000 7f07e8ff9700 20 reqs_thread_entry: start 2019-11-27T15:01:49.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.144+0000 7f07e27fc700 20 reqs_thread_entry: start 2019-11-27T15:01:49.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.144+0000 7f08b46c3ec0 20 init_complete bucket index max shards: 0 2019-11-27T15:01:49.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.144+0000 7f07e0ff9700 20 reqs_thread_entry: start 2019-11-27T15:01:49.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.315+0000 7f08b46c3ec0 20 remove_watcher() i=0 2019-11-27T15:01:49.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.315+0000 7f08b46c3ec0 2 removed watcher, disabling cache 2019-11-27T15:01:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.375+0000 7f08b46c3ec0 20 remove_watcher() i=1 2019-11-27T15:01:49.419 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.422+0000 7f08b46c3ec0 20 remove_watcher() i=2 2019-11-27T15:01:49.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.489+0000 7f08b46c3ec0 20 remove_watcher() i=3 2019-11-27T15:01:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.557+0000 7f08b46c3ec0 20 remove_watcher() i=4 2019-11-27T15:01:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.600+0000 7f08b46c3ec0 20 remove_watcher() i=5 2019-11-27T15:01:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.651+0000 7f08b46c3ec0 20 remove_watcher() i=6 2019-11-27T15:01:49.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.726+0000 7f08b46c3ec0 20 remove_watcher() i=7 2019-11-27T15:01:49.735 INFO:teuthology.orchestra.run.smithi156.stdout:[] 2019-11-27T15:01:49.735 DEBUG:tasks.util.rgw: json result: [] 2019-11-27T15:01:49.735 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-27T15:01:49.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-27T15:01:49.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-27T15:01:49.736 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-27T15:01:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.995+0000 7f2445ffb700 20 reqs_thread_entry: start 2019-11-27T15:01:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:49.995+0000 7f2511a63ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.007+0000 7f2511a63ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.007+0000 7f2511a63ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.016+0000 7f2511a63ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.016+0000 7f2511a63ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.043+0000 7f2511a63ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-27T15:01:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.043+0000 7f2511a63ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.060+0000 7f2511a63ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T15:01:50.167 INFO:teuthology.orchestra.run.smithi156.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-27T15:01:50.167 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-27T15:01:50.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-27T15:01:50.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-27T15:01:50.168 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-27T15:01:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.416+0000 7f66ceffd700 20 reqs_thread_entry: start 2019-11-27T15:01:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.416+0000 7f679989dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.430+0000 7f679989dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.430+0000 7f679989dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.452+0000 7f679989dec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-27T15:01:50.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.452+0000 7f679989dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.456+0000 7f679989dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.456+0000 7f679989dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.466+0000 7f679989dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:50.463 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.466+0000 7f679989dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.482+0000 7f679989dec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-27T15:01:50.556 INFO:teuthology.orchestra.run.smithi156.stdout:{"id":"52e9f6d5-9017-4df2-9490-35fe7d8cf870","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T15:01:50.556 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'52e9f6d5-9017-4df2-9490-35fe7d8cf870', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T15:01:50.556 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-27T15:01:50.556 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-27T15:01:50.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-27T15:01:50.557 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-27T15:01:50.725 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.728+0000 7f83cd7fa700 20 reqs_thread_entry: start 2019-11-27T15:01:50.726 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.729+0000 7f8490260ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.734 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.737+0000 7f8490260ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:50.734 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.738+0000 7f8490260ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.745+0000 7f8490260ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:50.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.746+0000 7f8490260ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.776+0000 7f8490260ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-27T15:01:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.776+0000 7f8490260ec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:50.798+0000 7f8490260ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-27T15:01:50.904 INFO:teuthology.orchestra.run.smithi156.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-27T15:01:50.904 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-27T15:01:50.904 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-27T15:01:50.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-27T15:01:50.905 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-27T15:01:51.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.125+0000 7f19e17fa700 20 reqs_thread_entry: start 2019-11-27T15:01:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.125+0000 7f1a9c24dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.139+0000 7f1a9c24dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.139+0000 7f1a9c24dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.162+0000 7f1a9c24dec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-27T15:01:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.162+0000 7f1a9c24dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.169+0000 7f1a9c24dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:01:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.169+0000 7f1a9c24dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.180+0000 7f1a9c24dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:01:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.180+0000 7f1a9c24dec0 20 rados->read ofs=0 len=0 2019-11-27T15:01:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:01:51.197+0000 7f1a9c24dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:01:51.273 INFO:teuthology.orchestra.run.smithi156.stdout:{"id":"52e9f6d5-9017-4df2-9490-35fe7d8cf870","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-27T15:01:51.274 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'52e9f6d5-9017-4df2-9490-35fe7d8cf870', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-27T15:01:51.274 INFO:tasks.rgw:Starting rgw... 2019-11-27T15:01:51.274 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-27T15:01:51.274 INFO:tasks.rgw:Using beast as radosgw frontend 2019-11-27T15:01:51.275 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-27T15:01:51.275 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-27T15:01:51.275 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-27T15:01:51.279 INFO:tasks.rgw.client.0:Started 2019-11-27T15:01:51.279 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:01:51.279 INFO:teuthology.orchestra.run.smithi156:> curl https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:01:51.369 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T15:01:51.370 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2019-11-27T15:01:51.374 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi156.front.sepia.ceph.com:443; Connection refused 2019-11-27T15:01:51.374 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T15:01:52.375 INFO:teuthology.orchestra.run.smithi156:> curl https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:01:52.470 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T15:01:52.470 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2019-11-27T15:01:52.473 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi156.front.sepia.ceph.com:443; Connection refused 2019-11-27T15:01:52.473 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T15:01:54.474 INFO:teuthology.orchestra.run.smithi156:> curl https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:01:54.534 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T15:01:54.534 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2019-11-27T15:01:54.538 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi156.front.sepia.ceph.com:443; Connection refused 2019-11-27T15:01:54.538 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T15:01:58.539 INFO:teuthology.orchestra.run.smithi156:> curl https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:01:58.602 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T15:01:58.603 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2019-11-27T15:01:58.606 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi156.front.sepia.ceph.com:443; Connection refused 2019-11-27T15:01:58.606 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-27T15:02:06.607 INFO:teuthology.orchestra.run.smithi156:> curl https://smithi156.front.sepia.ceph.com:443/ 2019-11-27T15:02:06.692 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-27T15:02:06.693 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2019-11-27T15:02:07.998 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 163 0 --:--:-- 0:00:01 --:--:-- 163 2019-11-27T15:02:07.999 INFO:teuthology.orchestra.run.smithi156.stdout:anonymous 2019-11-27T15:02:07.999 INFO:teuthology.run_tasks:Running task workunit... 2019-11-27T15:02:08.015 INFO:tasks.workunit:Pulling workunits from ref 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T15:02:08.015 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-27T15:02:08.015 INFO:teuthology.orchestra.run.smithi156:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-27T15:02:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-27T15:02:08.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T15:02:08.075 INFO:teuthology.orchestra.run.smithi156:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-27T15:02:08.138 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-27T15:02:08.138 INFO:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-27T15:02:08.185 INFO:tasks.workunit:timeout=3h 2019-11-27T15:02:08.185 INFO:tasks.workunit:cleanup=True 2019-11-27T15:02:08.186 INFO:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-27T15:02:08.291 INFO:tasks.workunit.client.0.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-27T15:02:42.631 INFO:tasks.workunit.client.0.smithi156.stderr:Note: checking out '00732956b62306ff37a7f7c81af9db807aae2dc8'. 2019-11-27T15:02:42.631 INFO:tasks.workunit.client.0.smithi156.stderr: 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr:state without impacting any branches by performing another checkout. 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr: 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-27T15:02:42.632 INFO:tasks.workunit.client.0.smithi156.stderr: 2019-11-27T15:02:42.633 INFO:tasks.workunit.client.0.smithi156.stderr: git checkout -b new_branch_name 2019-11-27T15:02:42.633 INFO:tasks.workunit.client.0.smithi156.stderr: 2019-11-27T15:02:42.633 INFO:tasks.workunit.client.0.smithi156.stderr:HEAD is now at 0073295... rgw: fix a bug that bucket instance obj can't be removed after resharding completed. 2019-11-27T15:02:42.634 INFO:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-27T15:02:42.700 INFO:tasks.workunit.client.0.smithi156.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-27T15:02:42.703 INFO:tasks.workunit.client.0.smithi156.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-27T15:02:42.703 INFO:tasks.workunit.client.0.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-27T15:02:43.168 INFO:tasks.workunit.client.0.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-27T15:02:43.244 INFO:tasks.workunit.client.0.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-27T15:02:43.278 INFO:tasks.workunit.client.0.smithi156.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-27T15:02:43.280 INFO:tasks.workunit.client.0.smithi156.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-27T15:02:43.280 INFO:tasks.workunit.client.0.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-27T15:02:43.313 INFO:tasks.workunit.client.0.smithi156.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-27T15:02:43.363 DEBUG:teuthology.orchestra.remote:smithi156:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-27T15:02:43.411 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-27T15:02:43.411 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-27T15:02:43.411 INFO:teuthology.orchestra.run.smithi156:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-27T15:02:43.465 INFO:tasks.workunit.client.0.smithi156.stdout:Running main() from gmock_main.cc 2019-11-27T15:02:43.465 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-27T15:02:43.465 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment set-up. 2019-11-27T15:02:43.465 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 11 tests from ClsLock 2019-11-27T15:02:43.465 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-27T15:02:46.233 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:46.233 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: exclusive 2019-11-27T15:02:46.234 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:46.234 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:46.234 INFO:tasks.workunit.client.0.smithi156.stdout: client.4552 expiration=2019-11-27T15:04:46.056700+0000 addr=v1:172.21.15.156:0/3292700187 cookie= 2019-11-27T15:02:46.424 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:46.424 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: shared 2019-11-27T15:02:46.424 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:46.425 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:46.425 INFO:tasks.workunit.client.0.smithi156.stdout: client.4552 expiration=2019-11-27T15:04:46.371235+0000 addr=v1:172.21.15.156:0/3292700187 cookie= 2019-11-27T15:02:46.425 INFO:tasks.workunit.client.0.smithi156.stdout: client.4558 expiration=0.000000 addr=v1:172.21.15.156:0/3389328497 cookie= 2019-11-27T15:02:46.469 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:46.469 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: shared 2019-11-27T15:02:46.469 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:46.469 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:46.469 INFO:tasks.workunit.client.0.smithi156.stdout: client.4558 expiration=0.000000 addr=v1:172.21.15.156:0/3389328497 cookie= 2019-11-27T15:02:46.946 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestMultiLocking (3480 ms) 2019-11-27T15:02:46.946 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestMeta 2019-11-27T15:02:49.798 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:49.798 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: shared 2019-11-27T15:02:49.798 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:49.799 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:49.799 INFO:tasks.workunit.client.0.smithi156.stdout: client.4364 expiration=0.000000 addr=v1:172.21.15.156:0/662375116 cookie= 2019-11-27T15:02:49.910 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:49.911 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: exclusive 2019-11-27T15:02:49.911 INFO:tasks.workunit.client.0.smithi156.stdout: tag: new_tag 2019-11-27T15:02:49.911 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:49.911 INFO:tasks.workunit.client.0.smithi156.stdout: client.4524 expiration=0.000000 addr=v1:172.21.15.156:0/525815347 cookie= 2019-11-27T15:02:50.373 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestMeta (3428 ms) 2019-11-27T15:02:50.374 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestCookie 2019-11-27T15:02:53.316 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:53.317 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: exclusive 2019-11-27T15:02:53.317 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:53.317 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:53.389 INFO:tasks.workunit.client.0.smithi156.stdout:lock: mylock 2019-11-27T15:02:53.390 INFO:tasks.workunit.client.0.smithi156.stdout: lock_type: shared 2019-11-27T15:02:53.390 INFO:tasks.workunit.client.0.smithi156.stdout: tag: 2019-11-27T15:02:53.390 INFO:tasks.workunit.client.0.smithi156.stdout: lockers: 2019-11-27T15:02:53.390 INFO:tasks.workunit.client.0.smithi156.stdout: client.4367 expiration=0.000000 addr=v1:172.21.15.156:0/481842237 cookie= 2019-11-27T15:02:53.390 INFO:tasks.workunit.client.0.smithi156.stdout: client.4367 expiration=0.000000 addr=v1:172.21.15.156:0/481842237 cookie=new cookie 2019-11-27T15:02:53.828 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestCookie (3455 ms) 2019-11-27T15:02:53.829 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-27T15:02:57.323 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestMultipleLocks (3494 ms) 2019-11-27T15:02:57.323 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-27T15:03:05.478 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestLockDuration (8155 ms) 2019-11-27T15:03:05.479 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-27T15:03:09.075 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestAssertLocked (3595 ms) 2019-11-27T15:03:09.076 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-27T15:03:12.463 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestSetCookie (3390 ms) 2019-11-27T15:03:12.463 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestRenew 2019-11-27T15:03:34.906 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestRenew (22444 ms) 2019-11-27T15:03:34.906 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-27T15:03:42.644 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7735 ms) 2019-11-27T15:03:42.645 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-27T15:03:51.088 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8444 ms) 2019-11-27T15:03:51.089 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-27T15:03:59.175 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8089 ms) 2019-11-27T15:03:59.175 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 11 tests from ClsLock (75710 ms total) 2019-11-27T15:03:59.175 INFO:tasks.workunit.client.0.smithi156.stdout: 2019-11-27T15:03:59.175 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment tear-down 2019-11-27T15:03:59.175 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] 11 tests from 1 test suite ran. (75710 ms total) 2019-11-27T15:03:59.176 INFO:tasks.workunit.client.0.smithi156.stdout:[ PASSED ] 11 tests. 2019-11-27T15:03:59.177 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T15:03:59.177 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T15:03:59.311 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-27T15:03:59.312 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-27T15:03:59.312 INFO:teuthology.orchestra.run.smithi156:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-27T15:03:59.369 INFO:tasks.workunit.client.0.smithi156.stdout:Running main() from gmock_main.cc 2019-11-27T15:03:59.369 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-27T15:03:59.369 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment set-up. 2019-11-27T15:03:59.369 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 4 tests from cls_log 2019-11-27T15:03:59.369 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-27T15:04:02.686 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_log.test_log_add_same_time (3318 ms) 2019-11-27T15:04:02.686 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-27T15:04:06.340 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_log.test_log_add_different_time (3654 ms) 2019-11-27T15:04:06.341 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_log.trim_by_time 2019-11-27T15:04:11.211 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_log.trim_by_time (4871 ms) 2019-11-27T15:04:11.212 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_log.trim_by_marker (4537 ms) 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 4 tests from cls_log (16380 ms total) 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout: 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment tear-down 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] 4 tests from 1 test suite ran. (16380 ms total) 2019-11-27T15:04:15.749 INFO:tasks.workunit.client.0.smithi156.stdout:[ PASSED ] 4 tests. 2019-11-27T15:04:15.751 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T15:04:15.751 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T15:04:15.820 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-27T15:04:15.820 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-27T15:04:15.820 INFO:teuthology.orchestra.run.smithi156:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-27T15:04:15.888 INFO:tasks.workunit.client.0.smithi156.stdout:Running main() from gmock_main.cc 2019-11-27T15:04:15.888 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-27T15:04:15.888 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment set-up. 2019-11-27T15:04:15.889 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 5 tests from cls_rgw 2019-11-27T15:04:15.889 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-27T15:04:19.347 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.test_implicit (3459 ms) 2019-11-27T15:04:19.347 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-27T15:04:23.018 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3671 ms) 2019-11-27T15:04:23.019 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-27T15:04:32.314 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T15:04:32.260+0000 37f90700 -1 osd.2 pg_epoch: 104 pg[25.6( v 103'4 (0'0,103'4] local-lis/les=99/100 n=2 ec=99/99 lis/c=99/99 les/c/f=100/100/0 sis=99) [2,1] r=0 lpr=99 crt=102'3 lcod 102'3 mlcod 102'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-27T15:04:33.652 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.test_put_snap (10634 ms) 2019-11-27T15:04:33.652 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-27T15:04:37.350 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.test_explicit (3698 ms) 2019-11-27T15:04:37.351 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.set 2019-11-27T15:04:40.851 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.set (3500 ms) 2019-11-27T15:04:40.852 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 5 tests from cls_rgw (24963 ms total) 2019-11-27T15:04:40.852 INFO:tasks.workunit.client.0.smithi156.stdout: 2019-11-27T15:04:40.852 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment tear-down 2019-11-27T15:04:40.852 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] 5 tests from 1 test suite ran. (24963 ms total) 2019-11-27T15:04:40.852 INFO:tasks.workunit.client.0.smithi156.stdout:[ PASSED ] 5 tests. 2019-11-27T15:04:40.853 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T15:04:40.854 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T15:04:40.922 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-27T15:04:40.923 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-27T15:04:40.923 INFO:teuthology.orchestra.run.smithi156:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-27T15:04:40.981 INFO:tasks.workunit.client.0.smithi156.stdout:Running main() from gmock_main.cc 2019-11-27T15:04:40.981 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-27T15:04:40.981 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment set-up. 2019-11-27T15:04:40.981 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 13 tests from cls_rgw 2019-11-27T15:04:43.072 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.index_basic 2019-11-27T15:04:44.799 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.index_basic (1727 ms) 2019-11-27T15:04:44.799 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-27T15:04:46.791 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1992 ms) 2019-11-27T15:04:46.791 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-27T15:04:48.877 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.index_remove_object (2086 ms) 2019-11-27T15:04:48.878 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-27T15:05:16.654 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.index_suggest (27777 ms) 2019-11-27T15:05:16.654 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.index_list 2019-11-27T15:05:18.295 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.index_list (1641 ms) 2019-11-27T15:05:18.295 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.bi_list 2019-11-27T15:05:21.827 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.bi_list (3532 ms) 2019-11-27T15:05:21.827 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.gc_set 2019-11-27T15:05:22.394 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.gc_set (568 ms) 2019-11-27T15:05:22.395 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.gc_list 2019-11-27T15:05:23.119 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.gc_list (724 ms) 2019-11-27T15:05:23.119 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-27T15:05:31.448 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.gc_defer (8329 ms) 2019-11-27T15:05:31.448 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-27T15:05:40.930 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.usage_basic (9482 ms) 2019-11-27T15:05:40.931 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-27T15:05:40.979 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.usage_clear_no_obj (49 ms) 2019-11-27T15:05:40.979 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-27T15:05:53.937 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.usage_clear (12958 ms) 2019-11-27T15:05:53.937 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-27T15:05:55.957 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] cls_rgw.bi_log_trim (2020 ms) 2019-11-27T15:05:56.714 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 13 tests from cls_rgw (72886 ms total) 2019-11-27T15:05:56.714 INFO:tasks.workunit.client.0.smithi156.stdout: 2019-11-27T15:05:56.714 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment tear-down 2019-11-27T15:05:56.715 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] 13 tests from 1 test suite ran. (75734 ms total) 2019-11-27T15:05:56.715 INFO:tasks.workunit.client.0.smithi156.stdout:[ PASSED ] 13 tests. 2019-11-27T15:05:56.716 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T15:05:56.717 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T15:05:56.784 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-27T15:05:56.785 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-27T15:05:56.785 INFO:teuthology.orchestra.run.smithi156:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-27T15:05:56.853 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-27T15:05:56.853 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment set-up. 2019-11-27T15:05:59.056 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 6 tests from rgw_gc_log 2019-11-27T15:05:59.056 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-27T15:05:59.702 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.init_existing_queue (646 ms) 2019-11-27T15:05:59.702 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-27T15:05:59.800 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.init_existing_omap (98 ms) 2019-11-27T15:05:59.800 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-27T15:05:59.967 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (167 ms) 2019-11-27T15:05:59.967 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-27T15:06:00.046 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (79 ms) 2019-11-27T15:06:00.046 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-27T15:06:00.154 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.defer1_after_init (108 ms) 2019-11-27T15:06:00.154 INFO:tasks.workunit.client.0.smithi156.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-27T15:06:00.190 INFO:tasks.workunit.client.0.smithi156.stdout:[ OK ] rgw_gc_log.defer2_before_init (36 ms) 2019-11-27T15:06:00.190 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] 6 tests from rgw_gc_log (1134 ms total) 2019-11-27T15:06:00.191 INFO:tasks.workunit.client.0.smithi156.stdout: 2019-11-27T15:06:00.191 INFO:tasks.workunit.client.0.smithi156.stdout:[----------] Global test environment tear-down 2019-11-27T15:06:00.367 INFO:tasks.workunit.client.0.smithi156.stdout:[==========] 6 tests from 1 test suite ran. (3514 ms total) 2019-11-27T15:06:00.368 INFO:tasks.workunit.client.0.smithi156.stdout:[ PASSED ] 6 tests. 2019-11-27T15:06:00.370 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-27T15:06:00.370 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-27T15:06:00.489 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-27T15:06:00.490 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-27T15:06:00.761 DEBUG:teuthology.parallel:result is None 2019-11-27T15:06:00.762 INFO:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T15:06:00.823 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T15:06:00.823 INFO:teuthology.orchestra.run.smithi156:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-27T15:06:00.868 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-27T15:06:00.868 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-27T15:06:01.283 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-27T15:06:01.284 INFO:tasks.ragweed:Downloading ragweed... 2019-11-27T15:06:01.284 INFO:tasks.ragweed:Using branch 'wip-mkogan-testing' for ragweed 2019-11-27T15:06:01.284 INFO:teuthology.orchestra.run.smithi156:> git clone -b wip-mkogan-testing git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-27T15:06:01.361 INFO:teuthology.orchestra.run.smithi156.stderr:fatal: Remote branch wip-mkogan-testing not found in upstream origin 2019-11-27T15:06:01.362 INFO:teuthology.orchestra.run.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-27T15:06:01.363 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-27T15:06:01.363 INFO:teuthology.orchestra.run.smithi156:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-27T15:06:01.455 INFO:teuthology.orchestra.run.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-27T15:06:01.553 INFO:tasks.ragweed:Creating rgw users... 2019-11-27T15:06:01.554 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-27T15:06:01.554 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key XKTJVXOTSXGFSLCNETEY --secret cvLqLVNdn+ZmAWbpfKHAkKD8LPhEpUHioOsVjiEhxZdGYpoVPb/ybg== --email sysuser.client.0+test@test.test --system true 2019-11-27T15:06:01.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.733+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:01.758 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.764+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:01.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.764+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:01.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.776+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:01.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.776+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:01.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.782+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:01.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.782+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:01.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:01.791+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:02.012 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.018+0000 7fc41f356ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:06:02.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.018+0000 7fc41f356ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:06:02.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.018+0000 7fc41f356ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:06:02.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.018+0000 7fc41f356ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:06:02.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.018+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.031+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:02.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.031+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.053+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:06:02.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.053+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.063+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:02.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.063+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.078 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.084+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:06:02.078 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.084+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.097+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:02.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.097+0000 7fc41f356ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:06:02.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.097+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.097 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.104+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:02.098 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.104+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.113 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.119+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:02.113 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.119+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.134 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.140+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:06:02.135 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.140+0000 7fc41f356ec0 20 zonegroup default 2019-11-27T15:06:02.135 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.141+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.148+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:02.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.148+0000 7fc41f356ec0 10 Cannot find current period zone using local zone 2019-11-27T15:06:02.143 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.148+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.154+0000 7fc41f356ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:02.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.154+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.169+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:02.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.169+0000 7fc41f356ec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:02.180 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.186+0000 7fc41f356ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:06:02.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.186+0000 7fc41f356ec0 20 zone default found 2019-11-27T15:06:02.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.186+0000 7fc41f356ec0 20 started sync module instance, tier type = 2019-11-27T15:06:02.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.186+0000 7fc41f356ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:06:02.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=0 2019-11-27T15:06:02.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=1 2019-11-27T15:06:02.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=2 2019-11-27T15:06:02.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=3 2019-11-27T15:06:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=4 2019-11-27T15:06:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=5 2019-11-27T15:06:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.590+0000 7fc41f356ec0 20 add_watcher() i=6 2019-11-27T15:06:02.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.619+0000 7fc41f356ec0 20 add_watcher() i=7 2019-11-27T15:06:02.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.619+0000 7fc41f356ec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:06:02.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.619+0000 7fc3dcfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:06:02.619 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.626+0000 7fc40bd82700 0 -- 172.21.15.156:0/2888219877 >> v2:172.21.15.3:3300/0 conn(0x55c9d6f55330 msgr2=0x55c9d6f57840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T15:06:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.829+0000 7fc40bd82700 0 --2- 172.21.15.156:0/2888219877 >> v2:172.21.15.3:3300/0 conn(0x55c9d6f55330 0x55c9d6f57840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T15:06:02.901 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:02.908+0000 7fc40cd84700 0 -- 172.21.15.156:0/2531527871 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7fc350017570 msgr2=0x7fc350019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:06:04.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.331+0000 7fc34effd700 20 reqs_thread_entry: start 2019-11-27T15:06:04.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.332+0000 7fc34cff9700 20 reqs_thread_entry: start 2019-11-27T15:06:04.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.332+0000 7fc41f356ec0 20 init_complete bucket index max shards: 0 2019-11-27T15:06:04.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.332+0000 7fc342ffd700 20 reqs_thread_entry: start 2019-11-27T15:06:04.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.332+0000 7fc41f356ec0 20 get_system_obj_state: rctx=0x7ffe34108c28 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55c9d6fd3000 s->prefetch_data=0 2019-11-27T15:06:04.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.332+0000 7fc41f356ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-27T15:06:04.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.345+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-27T15:06:04.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.345+0000 7fc41f356ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T15:06:04.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.345+0000 7fc41f356ec0 20 get_system_obj_state: rctx=0x7ffe34108c38 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55c9d6fd4d90 s->prefetch_data=0 2019-11-27T15:06:04.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.345+0000 7fc41f356ec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-27T15:06:04.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.354+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-27T15:06:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.354+0000 7fc41f356ec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T15:06:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.355+0000 7fc41f356ec0 20 get_system_obj_state: rctx=0x7ffe34108c38 obj=default.rgw.meta:users.keys:XKTJVXOTSXGFSLCNETEY state=0x55c9d6fd4d90 s->prefetch_data=0 2019-11-27T15:06:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.355+0000 7fc41f356ec0 10 cache get: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY : miss 2019-11-27T15:06:04.359 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.365+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY info.flags=0x0 2019-11-27T15:06:04.359 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.365+0000 7fc41f356ec0 10 adding default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY to cache LRU end 2019-11-27T15:06:04.359 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.365+0000 7fc41f356ec0 20 get_system_obj_state: rctx=0x7ffe34108848 obj=default.rgw.meta:users.keys:XKTJVXOTSXGFSLCNETEY state=0x55c9d6fd4d90 s->prefetch_data=0 2019-11-27T15:06:04.360 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.365+0000 7fc41f356ec0 10 cache get: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY : type miss (requested=0x6, cached=0x0) 2019-11-27T15:06:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.378+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY info.flags=0x0 2019-11-27T15:06:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.378+0000 7fc41f356ec0 10 moving default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY to cache LRU end 2019-11-27T15:06:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.378+0000 7fc41f356ec0 20 get_system_obj_state: rctx=0x7ffe341089c8 obj=default.rgw.meta:users.keys:XKTJVXOTSXGFSLCNETEY state=0x55c9d6fd4d90 s->prefetch_data=0 2019-11-27T15:06:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.378+0000 7fc41f356ec0 10 cache get: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY : type miss (requested=0x6, cached=0x0) 2019-11-27T15:06:04.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.386+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY info.flags=0x0 2019-11-27T15:06:04.380 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.386+0000 7fc41f356ec0 10 moving default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY to cache LRU end 2019-11-27T15:06:04.447 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.453+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-27T15:06:04.447 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.453+0000 7fc41f356ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T15:06:04.448 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.453+0000 7fc41f356ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-27T15:06:04.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.480+0000 7fc401ffb700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 94325383072240 notifier 4681 bl.length()=637 2019-11-27T15:06:04.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.480+0000 7fc401ffb700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-27T15:06:04.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.480+0000 7fc401ffb700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T15:06:04.707 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.713+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-27T15:06:04.707 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.713+0000 7fc41f356ec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T15:06:04.707 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.713+0000 7fc41f356ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-27T15:06:04.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.749+0000 7fc401ffb700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 94325383089968 notifier 4681 bl.length()=202 2019-11-27T15:06:04.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.749+0000 7fc401ffb700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-27T15:06:04.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.749+0000 7fc401ffb700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-27T15:06:04.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.945+0000 7fc41f356ec0 10 cache put: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY info.flags=0x7 2019-11-27T15:06:04.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.945+0000 7fc41f356ec0 10 moving default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY to cache LRU end 2019-11-27T15:06:04.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.945+0000 7fc41f356ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=190 2019-11-27T15:06:04.968 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.974+0000 7fc401ffb700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 94325383068464 notifier 4681 bl.length()=190 2019-11-27T15:06:04.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.975+0000 7fc401ffb700 10 cache put: name=default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY info.flags=0x7 2019-11-27T15:06:04.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:04.975+0000 7fc401ffb700 10 moving default.rgw.meta+users.keys+XKTJVXOTSXGFSLCNETEY to cache LRU end 2019-11-27T15:06:05.163 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T15:06:05.163 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "sysuser.client.0", 2019-11-27T15:06:05.163 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-27T15:06:05.163 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "sysuser.client.0", 2019-11-27T15:06:05.164 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "XKTJVXOTSXGFSLCNETEY", 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "cvLqLVNdn+ZmAWbpfKHAkKD8LPhEpUHioOsVjiEhxZdGYpoVPb/ybg==" 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T15:06:05.165 INFO:teuthology.orchestra.run.smithi156.stdout: "system": "true", 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:06:05.166 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:06:05.167 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T15:06:05.168 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.241+0000 7fc41f356ec0 20 remove_watcher() i=0 2019-11-27T15:06:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.241+0000 7fc41f356ec0 2 removed watcher, disabling cache 2019-11-27T15:06:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.304+0000 7fc41f356ec0 20 remove_watcher() i=1 2019-11-27T15:06:05.334 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.340+0000 7fc41f356ec0 20 remove_watcher() i=2 2019-11-27T15:06:05.384 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.390+0000 7fc41f356ec0 20 remove_watcher() i=3 2019-11-27T15:06:05.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.432+0000 7fc41f356ec0 20 remove_watcher() i=4 2019-11-27T15:06:05.466 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.472+0000 7fc41f356ec0 20 remove_watcher() i=5 2019-11-27T15:06:05.510 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.516+0000 7fc41f356ec0 20 remove_watcher() i=6 2019-11-27T15:06:05.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.554+0000 7fc41f356ec0 20 remove_watcher() i=7 2019-11-27T15:06:05.556 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-27T15:06:05.557 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key ZBQUHWHIWWFRXEJQTSRE --secret X9MDG2uUxzgtbr+a4QAEfoXXBiZvgdJZ8p+QhrtwXUJICmI0zm9lvA== --email ragweed.client.0+test@test.test --system false 2019-11-27T15:06:05.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.696+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.710 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.716+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:05.710 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.716+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.721 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.727+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:05.721 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.727+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.733+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:05.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.733+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.741+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:05.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.954+0000 7f4d8e54cec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:06:05.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.954+0000 7f4d8e54cec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:06:05.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.954+0000 7f4d8e54cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:06:05.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.954+0000 7f4d8e54cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:06:05.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.954+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.963+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:05.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.963+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.977+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:06:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.977+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.986+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:05.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:05.986+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:05.996 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.002+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:06:05.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.002+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.008 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.014+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:06.008 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.014+0000 7f4d8e54cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:06:06.008 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.014+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.023+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.023+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.038+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:06.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.038+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.058+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:06:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.058+0000 7f4d8e54cec0 20 zonegroup default 2019-11-27T15:06:06.053 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.058+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.067+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:06.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.067+0000 7f4d8e54cec0 10 Cannot find current period zone using local zone 2019-11-27T15:06:06.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.067+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.075+0000 7f4d8e54cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:06:06.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.075+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.080 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.086+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:06:06.080 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.086+0000 7f4d8e54cec0 20 rados->read ofs=0 len=0 2019-11-27T15:06:06.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.106+0000 7f4d8e54cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:06:06.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.106+0000 7f4d8e54cec0 20 zone default found 2019-11-27T15:06:06.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.106+0000 7f4d8e54cec0 20 started sync module instance, tier type = 2019-11-27T15:06:06.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.106+0000 7f4d8e54cec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:06:06.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=0 2019-11-27T15:06:06.559 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=1 2019-11-27T15:06:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=2 2019-11-27T15:06:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=3 2019-11-27T15:06:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=4 2019-11-27T15:06:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=5 2019-11-27T15:06:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.546+0000 7f4d8e54cec0 20 add_watcher() i=6 2019-11-27T15:06:06.576 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.582+0000 7f4d8e54cec0 20 add_watcher() i=7 2019-11-27T15:06:06.576 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.582+0000 7f4d8e54cec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:06:06.577 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.582+0000 7f4d4bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:06:06.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.600+0000 7f4d7b779700 0 -- 172.21.15.156:0/68547822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55719f72f0f0 msgr2=0x55719f731550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:06:06.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:06.635+0000 7f4d7b779700 0 -- 172.21.15.156:0/2802914136 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55719f7355d0 msgr2=0x55719f7379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:06:08.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.067+0000 7f4cba7fc700 20 reqs_thread_entry: start 2019-11-27T15:06:08.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.067+0000 7f4cb3fff700 20 reqs_thread_entry: start 2019-11-27T15:06:08.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.067+0000 7f4d8e54cec0 20 init_complete bucket index max shards: 0 2019-11-27T15:06:08.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.067+0000 7f4cb27fc700 20 reqs_thread_entry: start 2019-11-27T15:06:08.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.067+0000 7f4d8e54cec0 20 get_system_obj_state: rctx=0x7ffca1828858 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55719f7ad060 s->prefetch_data=0 2019-11-27T15:06:08.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.068+0000 7f4d8e54cec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-27T15:06:08.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.073+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-27T15:06:08.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.073+0000 7f4d8e54cec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T15:06:08.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.073+0000 7f4d8e54cec0 20 get_system_obj_state: rctx=0x7ffca1828868 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x55719f7aedf0 s->prefetch_data=0 2019-11-27T15:06:08.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.073+0000 7f4d8e54cec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-27T15:06:08.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.079+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-27T15:06:08.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.079+0000 7f4d8e54cec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T15:06:08.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.079+0000 7f4d8e54cec0 20 get_system_obj_state: rctx=0x7ffca1828868 obj=default.rgw.meta:users.keys:ZBQUHWHIWWFRXEJQTSRE state=0x55719f7aedf0 s->prefetch_data=0 2019-11-27T15:06:08.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.079+0000 7f4d8e54cec0 10 cache get: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE : miss 2019-11-27T15:06:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.089+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE info.flags=0x0 2019-11-27T15:06:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.089+0000 7f4d8e54cec0 10 adding default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE to cache LRU end 2019-11-27T15:06:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.089+0000 7f4d8e54cec0 20 get_system_obj_state: rctx=0x7ffca1828478 obj=default.rgw.meta:users.keys:ZBQUHWHIWWFRXEJQTSRE state=0x55719f7aedf0 s->prefetch_data=0 2019-11-27T15:06:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.089+0000 7f4d8e54cec0 10 cache get: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE : type miss (requested=0x6, cached=0x0) 2019-11-27T15:06:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.102+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE info.flags=0x0 2019-11-27T15:06:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.102+0000 7f4d8e54cec0 10 moving default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE to cache LRU end 2019-11-27T15:06:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.102+0000 7f4d8e54cec0 20 get_system_obj_state: rctx=0x7ffca18285f8 obj=default.rgw.meta:users.keys:ZBQUHWHIWWFRXEJQTSRE state=0x55719f7aedf0 s->prefetch_data=0 2019-11-27T15:06:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.102+0000 7f4d8e54cec0 10 cache get: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE : type miss (requested=0x6, cached=0x0) 2019-11-27T15:06:08.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.114+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE info.flags=0x0 2019-11-27T15:06:08.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.114+0000 7f4d8e54cec0 10 moving default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE to cache LRU end 2019-11-27T15:06:08.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.157+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-27T15:06:08.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.157+0000 7f4d8e54cec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T15:06:08.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.157+0000 7f4d8e54cec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-27T15:06:08.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.166+0000 7f4d70ff9700 10 RGWWatcher::handle_notify() notify_id 528280977409 cookie 93946494692816 notifier 4693 bl.length()=637 2019-11-27T15:06:08.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.166+0000 7f4d70ff9700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-27T15:06:08.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.166+0000 7f4d70ff9700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T15:06:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.743+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-27T15:06:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.743+0000 7f4d8e54cec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T15:06:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.743+0000 7f4d8e54cec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-27T15:06:08.748 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.754+0000 7f4d70ff9700 10 RGWWatcher::handle_notify() notify_id 528280977409 cookie 93946494673568 notifier 4693 bl.length()=202 2019-11-27T15:06:08.749 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.754+0000 7f4d70ff9700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-27T15:06:08.749 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:08.754+0000 7f4d70ff9700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-27T15:06:09.087 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.093+0000 7f4d8e54cec0 10 cache put: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE info.flags=0x7 2019-11-27T15:06:09.087 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.093+0000 7f4d8e54cec0 10 moving default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE to cache LRU end 2019-11-27T15:06:09.087 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.093+0000 7f4d8e54cec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2019-11-27T15:06:09.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.107+0000 7f4d70ff9700 10 RGWWatcher::handle_notify() notify_id 528280977410 cookie 93946494694528 notifier 4693 bl.length()=190 2019-11-27T15:06:09.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.107+0000 7f4d70ff9700 10 cache put: name=default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE info.flags=0x7 2019-11-27T15:06:09.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.107+0000 7f4d70ff9700 10 moving default.rgw.meta+users.keys+ZBQUHWHIWWFRXEJQTSRE to cache LRU end 2019-11-27T15:06:09.251 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T15:06:09.251 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "ragweed.client.0", 2019-11-27T15:06:09.251 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-27T15:06:09.251 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-27T15:06:09.251 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "ragweed.client.0", 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "ZBQUHWHIWWFRXEJQTSRE", 2019-11-27T15:06:09.252 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "X9MDG2uUxzgtbr+a4QAEfoXXBiZvgdJZ8p+QhrtwXUJICmI0zm9lvA==" 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: "system": "true", 2019-11-27T15:06:09.253 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:06:09.254 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:06:09.255 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T15:06:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:09.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.318+0000 7f4d8e54cec0 20 remove_watcher() i=0 2019-11-27T15:06:09.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.318+0000 7f4d8e54cec0 2 removed watcher, disabling cache 2019-11-27T15:06:09.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.350+0000 7f4d8e54cec0 20 remove_watcher() i=1 2019-11-27T15:06:09.376 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.382+0000 7f4d8e54cec0 20 remove_watcher() i=2 2019-11-27T15:06:09.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.467+0000 7f4d8e54cec0 20 remove_watcher() i=3 2019-11-27T15:06:09.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.500+0000 7f4d8e54cec0 20 remove_watcher() i=4 2019-11-27T15:06:09.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.551+0000 7f4d8e54cec0 20 remove_watcher() i=5 2019-11-27T15:06:09.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.593+0000 7f4d8e54cec0 20 remove_watcher() i=6 2019-11-27T15:06:09.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:06:09.628+0000 7f4d8e54cec0 20 remove_watcher() i=7 2019-11-27T15:06:09.633 INFO:tasks.ragweed:Configuring ragweed... 2019-11-27T15:06:09.633 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-27T15:06:16.184 INFO:teuthology.orchestra.run.smithi156.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-27T15:06:16.284 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T15:06:16.320 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T15:06:16.321 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T15:06:16.322 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T15:06:16.322 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T15:06:16.322 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T15:06:16.932 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T15:06:17.285 INFO:teuthology.orchestra.run.smithi156.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-27T15:06:18.167 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T15:06:18.168 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T15:06:18.168 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-27T15:06:18.170 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-27T15:06:18.172 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-27T15:06:18.206 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-27T15:06:18.207 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-27T15:06:18.210 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-27T15:06:18.210 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T15:06:18.210 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-27T15:06:18.212 INFO:teuthology.orchestra.run.smithi156.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-27T15:06:18.215 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-27T15:06:18.216 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T15:06:18.216 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-27T15:06:18.600 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T15:06:18.820 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:18.820 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T15:06:18.821 INFO:teuthology.orchestra.run.smithi156.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout:Installing for dependencies: 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-27T15:06:18.822 INFO:teuthology.orchestra.run.smithi156.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-27T15:06:18.823 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:18.823 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T15:06:18.823 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T15:06:18.823 INFO:teuthology.orchestra.run.smithi156.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-27T15:06:18.823 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:18.824 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.7 M 2019-11-27T15:06:18.824 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 12 M 2019-11-27T15:06:18.824 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T15:06:19.161 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2019-11-27T15:06:19.161 INFO:teuthology.orchestra.run.smithi156.stdout:Total 4.9 MB/s | 1.7 MB 00:00 2019-11-27T15:06:19.170 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T15:06:19.184 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T15:06:19.254 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T15:06:19.254 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T15:06:19.788 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-27T15:06:20.138 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-27T15:06:20.419 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-27T15:06:20.979 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-27T15:06:21.382 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-27T15:06:21.744 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-27T15:06:22.011 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-27T15:06:22.135 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-27T15:06:22.278 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-27T15:06:22.403 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-27T15:06:22.520 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-27T15:06:22.662 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-27T15:06:22.788 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-27T15:06:23.339 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:23.340 INFO:teuthology.orchestra.run.smithi156.stdout:Dependency Installed: 2019-11-27T15:06:23.341 INFO:teuthology.orchestra.run.smithi156.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-27T15:06:23.341 INFO:teuthology.orchestra.run.smithi156.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-27T15:06:23.341 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:23.341 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T15:06:23.537 INFO:teuthology.orchestra.run.smithi156.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-27T15:06:25.108 INFO:teuthology.orchestra.run.smithi156.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T15:06:25.590 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pip 2019-11-27T15:06:25.701 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-27T15:06:25.895 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: pip 2019-11-27T15:06:25.895 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: pip 9.0.1 2019-11-27T15:06:25.954 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling pip-9.0.1: 2019-11-27T15:06:25.995 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T15:06:26.572 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed pip-19.3.1 2019-11-27T15:06:27.356 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T15:06:27.421 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-27T15:06:28.173 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T15:06:28.336 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting nose 2019-11-27T15:06:28.386 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-27T15:06:28.563 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: nose 2019-11-27T15:06:28.651 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed nose-1.3.7 2019-11-27T15:06:29.193 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T15:06:29.846 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting setuptools==32.3.1 2019-11-27T15:06:29.886 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-27T15:06:30.091 INFO:teuthology.orchestra.run.smithi156.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-27T15:06:30.091 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: setuptools 2019-11-27T15:06:30.092 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T15:06:30.112 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T15:06:30.124 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T15:06:30.256 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed setuptools-32.3.1 2019-11-27T15:06:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T15:06:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting PyYAML 2019-11-27T15:06:31.159 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-27T15:06:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-27T15:06:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-27T15:06:32.056 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-27T15:06:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting bunch>=1.0.0 2019-11-27T15:06:32.373 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-27T15:06:33.058 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting gevent>=1.0 2019-11-27T15:06:33.076 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-27T15:06:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting httplib2 2019-11-27T15:06:33.545 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-27T15:06:34.990 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting lxml 2019-11-27T15:06:35.010 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-27T15:06:35.502 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T15:06:35.512 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T15:06:35.598 INFO:teuthology.orchestra.run.smithi156.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-27T15:06:35.599 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for PyYAML (setup.py): started 2019-11-27T15:06:36.225 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-27T15:06:36.225 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=e23bcf3598f3661fdbf48aee53ba1a1f722eabe2a37d5cfbda0ede1d5428ce8b 2019-11-27T15:06:36.225 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-27T15:06:36.245 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for bunch (setup.py): started 2019-11-27T15:06:36.584 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-27T15:06:36.585 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=95b8fd72cddf67602d6dbcba4087274b17cd143eb13009f7edd9ea6f9152f10a 2019-11-27T15:06:36.585 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-27T15:06:36.587 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for httplib2 (setup.py): started 2019-11-27T15:06:36.959 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-27T15:06:36.960 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=7b0a2a078ccd234d4bfae68046a952a377b8c6fca1a672ebc08862d429b3b3fc 2019-11-27T15:06:36.960 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-27T15:06:36.965 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully built PyYAML bunch httplib2 2019-11-27T15:06:37.072 INFO:teuthology.orchestra.run.smithi156.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-27T15:06:37.072 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-27T15:06:37.072 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: PyYAML 3.10 2019-11-27T15:06:37.073 INFO:teuthology.orchestra.run.smithi156.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-27T15:06:37.073 INFO:teuthology.orchestra.run.smithi156.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-27T15:06:38.228 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: lxml 3.2.1 2019-11-27T15:06:38.230 INFO:teuthology.orchestra.run.smithi156.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-27T15:06:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-27T15:06:38.345 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-11-27T15:06:38.786 INFO:teuthology.orchestra.run.smithi156.stdout:running develop 2019-11-27T15:06:38.852 INFO:teuthology.orchestra.run.smithi156.stdout:running egg_info 2019-11-27T15:06:38.852 INFO:teuthology.orchestra.run.smithi156.stdout:creating ragweed.egg-info 2019-11-27T15:06:38.852 INFO:teuthology.orchestra.run.smithi156.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-27T15:06:38.852 INFO:teuthology.orchestra.run.smithi156.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-27T15:06:38.852 INFO:teuthology.orchestra.run.smithi156.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-27T15:06:38.853 INFO:teuthology.orchestra.run.smithi156.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-27T15:06:38.853 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T15:06:38.853 INFO:teuthology.orchestra.run.smithi156.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T15:06:38.853 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-27T15:06:38.854 INFO:teuthology.orchestra.run.smithi156.stdout:running build_ext 2019-11-27T15:06:38.855 INFO:teuthology.orchestra.run.smithi156.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-27T15:06:38.855 INFO:teuthology.orchestra.run.smithi156.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-27T15:06:38.855 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:38.855 INFO:teuthology.orchestra.run.smithi156.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-27T15:06:38.856 INFO:teuthology.orchestra.run.smithi156.stdout:Processing dependencies for ragweed==0.0.1 2019-11-27T15:06:38.860 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for isodate>=0.4.4 2019-11-27T15:06:38.860 INFO:teuthology.orchestra.run.smithi156.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-27T15:06:38.953 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-27T15:06:39.003 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: isodate 0.6.0 2019-11-27T15:06:39.004 INFO:teuthology.orchestra.run.smithi156.stdout:Processing isodate-0.6.0.tar.gz 2019-11-27T15:06:39.009 INFO:teuthology.orchestra.run.smithi156.stdout:Writing /tmp/easy_install-jFlcr1/isodate-0.6.0/setup.cfg 2019-11-27T15:06:39.010 INFO:teuthology.orchestra.run.smithi156.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-jFlcr1/isodate-0.6.0/egg-dist-tmp-u3McIG 2019-11-27T15:06:39.299 INFO:teuthology.orchestra.run.smithi156.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-27T15:06:39.315 INFO:teuthology.orchestra.run.smithi156.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.316 INFO:teuthology.orchestra.run.smithi156.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-27T15:06:39.317 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.317 INFO:teuthology.orchestra.run.smithi156.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-27T15:06:39.343 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for gevent==1.4.0 2019-11-27T15:06:39.344 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: gevent 1.4.0 2019-11-27T15:06:39.344 INFO:teuthology.orchestra.run.smithi156.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-27T15:06:39.344 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.344 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.345 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for bunch==1.0.1 2019-11-27T15:06:39.345 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: bunch 1.0.1 2019-11-27T15:06:39.345 INFO:teuthology.orchestra.run.smithi156.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-27T15:06:39.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.346 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.347 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for PyYAML==5.1.2 2019-11-27T15:06:39.347 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: PyYAML 5.1.2 2019-11-27T15:06:39.347 INFO:teuthology.orchestra.run.smithi156.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-27T15:06:39.347 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.347 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.348 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for boto==2.49.0 2019-11-27T15:06:39.348 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: boto 2.49.0 2019-11-27T15:06:39.348 INFO:teuthology.orchestra.run.smithi156.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-27T15:06:39.348 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.348 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.349 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for six==1.9.0 2019-11-27T15:06:39.349 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: six 1.9.0 2019-11-27T15:06:39.349 INFO:teuthology.orchestra.run.smithi156.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-27T15:06:39.349 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.349 INFO:teuthology.orchestra.run.smithi156.stdout:Using /usr/lib/python2.7/site-packages 2019-11-27T15:06:39.354 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for greenlet==0.4.15 2019-11-27T15:06:39.355 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: greenlet 0.4.15 2019-11-27T15:06:39.355 INFO:teuthology.orchestra.run.smithi156.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-27T15:06:39.355 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:06:39.356 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-27T15:06:39.356 INFO:teuthology.orchestra.run.smithi156.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-27T15:06:39.376 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-27T15:06:39.452 INFO:tasks.ragweed:Configuring boto... 2019-11-27T15:06:39.452 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-27T15:06:39.565 INFO:teuthology.orchestra.run.smithi156:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-27T15:07:57.174 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-27T15:08:55.082 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:09:02.563 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.654 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:09:02.645 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.655 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:09:02.721 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.655 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:09:03.248 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.655 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:02.677 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.655 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:02.764 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.656 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:03.355 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.656 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:09:02.671 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:00.656 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:09:03.362 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:09:05.413 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-27T15:10:00.973 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-27T15:11:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-27T15:11:26.620 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:11:34.103 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.631 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:11:34.115 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.640 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:11:34.128 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.643 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:11:34.131 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.643 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:11:34.131 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.648 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:11:34.136 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.754 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:11:34.242 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.761 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:11:34.245 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:11:26.798 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:11:34.286 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:12:45.006 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-27T15:15:20.297 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-27T15:16:32.704 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:16:40.192 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.712 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:16:40.200 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.742 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:16:40.235 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.756 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:16:40.248 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.758 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:16:40.251 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.763 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:16:40.256 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.899 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:16:40.387 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.919 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:16:40.412 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:16:32.959 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:16:40.452 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.798 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:17:24.285 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.808 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:17:24.296 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.818 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:24.311 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.828 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:17:24.321 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.842 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:24.335 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.850 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:17:24.339 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.852 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:17:24.345 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.890 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:17:24.383 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:16.905 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:24.398 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:17:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-27T15:21:44.955 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:21:52.435 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.123 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:21:52.508 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.123 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:21:52.511 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.123 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:21:52.535 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.123 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:21:52.539 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.124 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:21:52.444 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.156 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:21:52.645 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.190 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:21:52.678 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:21:45.222 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:21:52.703 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:22:51.727 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-27T15:23:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-27T15:23:50.346 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T15:23:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:---------------------------------------------------------------------- 2019-11-27T15:23:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:Ran 9 tests in 1030.327s 2019-11-27T15:23:50.346 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T15:23:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:OK 2019-11-27T15:23:50.367 INFO:tasks.ragweed:Cleaning up boto... 2019-11-27T15:23:50.367 INFO:teuthology.orchestra.run.smithi156:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-27T15:23:50.431 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-27T15:23:50.543 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.550+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.574+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.574+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.586+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.586+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.593+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.593+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.602+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:50.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.833+0000 7f53f89b4ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:23:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.833+0000 7f53f89b4ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:23:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.833+0000 7f53f89b4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:23:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.833+0000 7f53f89b4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:23:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.833+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.846+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:50.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.846+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.863+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:23:50.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.863+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.879+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.879+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.895+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:23:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.895+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.904+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.904+0000 7f53f89b4ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:23:50.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.904+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.910+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.910+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.920+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.920+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.939+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:23:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.939+0000 7f53f89b4ec0 20 zonegroup default 2019-11-27T15:23:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.939+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.945+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.945+0000 7f53f89b4ec0 10 Cannot find current period zone using local zone 2019-11-27T15:23:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.945+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.951+0000 7f53f89b4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.951+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.951 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.958+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:50.951 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.958+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.975+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:23:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.976+0000 7f53f89b4ec0 20 zone default found 2019-11-27T15:23:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.976+0000 7f53f89b4ec0 20 started sync module instance, tier type = 2019-11-27T15:23:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:50.976+0000 7f53f89b4ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:23:51.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=0 2019-11-27T15:23:51.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=1 2019-11-27T15:23:51.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=2 2019-11-27T15:23:51.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=3 2019-11-27T15:23:51.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=4 2019-11-27T15:23:51.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=5 2019-11-27T15:23:51.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.417+0000 7f53f89b4ec0 20 add_watcher() i=6 2019-11-27T15:23:51.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.455+0000 7f53f89b4ec0 20 add_watcher() i=7 2019-11-27T15:23:51.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.455+0000 7f53f89b4ec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:23:51.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.455+0000 7f53b67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:23:51.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.466+0000 7f53e53e0700 0 -- 172.21.15.156:0/1973604673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5569e2ebe460 msgr2=0x5569e2ec0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:23:51.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:51.505+0000 7f53e5be1700 0 -- 172.21.15.156:0/2779179414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5569e2ebd8b0 msgr2=0x5569e2ec4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:23:52.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.870+0000 7f532cff9700 20 reqs_thread_entry: start 2019-11-27T15:23:52.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.871+0000 7f53267fc700 20 reqs_thread_entry: start 2019-11-27T15:23:52.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.871+0000 7f53f89b4ec0 20 init_complete bucket index max shards: 0 2019-11-27T15:23:52.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.871+0000 7f5324ff9700 20 reqs_thread_entry: start 2019-11-27T15:23:52.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.871+0000 7f53f89b4ec0 20 get_system_obj_state: rctx=0x7ffe86912348 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5569e2f35760 s->prefetch_data=0 2019-11-27T15:23:52.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.871+0000 7f53f89b4ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-27T15:23:52.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-27T15:23:52.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T15:23:52.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:52.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:23:52.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T15:23:52.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.886+0000 7f53f89b4ec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:52.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.903+0000 7f53f89b4ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-27T15:23:52.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.903+0000 7f53f89b4ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-27T15:23:52.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.903+0000 7f53f89b4ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-27T15:23:52.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.921+0000 7f53f89b4ec0 10 removing key index: XKTJVXOTSXGFSLCNETEY 2019-11-27T15:23:52.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.921+0000 7f53f89b4ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=170 2019-11-27T15:23:52.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:52.929+0000 7f53c6ffd700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 93913266916528 notifier 4469 bl.length()=170 2019-11-27T15:23:53.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.393+0000 7f53f89b4ec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-27T15:23:53.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.393+0000 7f53f89b4ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-27T15:23:53.401 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.409+0000 7f53c6ffd700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 93913266924960 notifier 4469 bl.length()=182 2019-11-27T15:23:53.489 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.496+0000 7f53f89b4ec0 10 removing user buckets index 2019-11-27T15:23:53.489 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.497+0000 7f53f89b4ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-27T15:23:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.518+0000 7f53c6ffd700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 93913266921776 notifier 4469 bl.length()=173 2019-11-27T15:23:53.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.894+0000 7f53f89b4ec0 10 removing user index: sysuser.client.0 2019-11-27T15:23:53.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.894+0000 7f53f89b4ec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-27T15:23:53.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.894+0000 7f53f89b4ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-27T15:23:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:53.912+0000 7f53c6ffd700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 93913266919728 notifier 4469 bl.length()=165 2019-11-27T15:23:54.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.251+0000 7f53f89b4ec0 20 remove_watcher() i=0 2019-11-27T15:23:54.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.251+0000 7f53f89b4ec0 2 removed watcher, disabling cache 2019-11-27T15:23:54.279 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.286+0000 7f53f89b4ec0 20 remove_watcher() i=1 2019-11-27T15:23:54.313 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.319+0000 7f53f89b4ec0 20 remove_watcher() i=2 2019-11-27T15:23:54.376 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.383+0000 7f53f89b4ec0 20 remove_watcher() i=3 2019-11-27T15:23:54.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.441+0000 7f53f89b4ec0 20 remove_watcher() i=4 2019-11-27T15:23:54.479 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.486+0000 7f53f89b4ec0 20 remove_watcher() i=5 2019-11-27T15:23:54.534 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.541+0000 7f53f89b4ec0 20 remove_watcher() i=6 2019-11-27T15:23:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.609+0000 7f53f89b4ec0 20 remove_watcher() i=7 2019-11-27T15:23:54.612 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-27T15:23:54.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.724+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:54.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.748+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:54.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.748+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:54.750 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.757+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:54.750 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.757+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:54.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.762+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:54.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.762+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:54.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:54.776+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:55.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.033+0000 7f1e5dc3eec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:23:55.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.033+0000 7f1e5dc3eec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:23:55.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.033+0000 7f1e5dc3eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:23:55.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.033+0000 7f1e5dc3eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:23:55.028 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.033+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.047+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:55.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.047+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.068+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:23:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.068+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.077+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.077+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.099+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:23:55.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.099+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.107+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:55.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.107+0000 7f1e5dc3eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:23:55.102 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.107+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.117+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:55.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.117+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.121 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.128+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:55.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.128+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.147+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.147+0000 7f1e5dc3eec0 20 zonegroup default 2019-11-27T15:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.147+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.154+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:55.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.154+0000 7f1e5dc3eec0 10 Cannot find current period zone using local zone 2019-11-27T15:23:55.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.154+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.166+0000 7f1e5dc3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:23:55.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.166+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.175+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:23:55.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.175+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:55.188 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.195+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:23:55.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.195+0000 7f1e5dc3eec0 20 zone default found 2019-11-27T15:23:55.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.195+0000 7f1e5dc3eec0 20 started sync module instance, tier type = 2019-11-27T15:23:55.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.195+0000 7f1e5dc3eec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=0 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=1 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=2 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=3 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=4 2019-11-27T15:23:55.684 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=5 2019-11-27T15:23:55.685 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.690+0000 7f1e5dc3eec0 20 add_watcher() i=6 2019-11-27T15:23:55.729 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.736+0000 7f1e5dc3eec0 20 add_watcher() i=7 2019-11-27T15:23:55.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.736+0000 7f1e5dc3eec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:23:55.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.736+0000 7f1e1b7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:23:55.735 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.741+0000 7f1e4ae6b700 0 -- 172.21.15.156:0/434126815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55cb66db0e60 msgr2=0x55cb66db32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T15:23:55.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:55.801+0000 7f1e4a66a700 0 -- 172.21.15.156:0/2980592738 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x55cb66dc70f0 msgr2=0x55cb66dc9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:23:57.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.530+0000 7f1e01ffb700 20 reqs_thread_entry: start 2019-11-27T15:23:57.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.531+0000 7f1d837fe700 20 reqs_thread_entry: start 2019-11-27T15:23:57.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.531+0000 7f1e5dc3eec0 20 init_complete bucket index max shards: 0 2019-11-27T15:23:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.531+0000 7f1d81ffb700 20 reqs_thread_entry: start 2019-11-27T15:23:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.532+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d30138 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55cb66e33be0 s->prefetch_data=0 2019-11-27T15:23:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.532+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-27T15:23:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-27T15:23:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T15:23:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:23:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T15:23:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.544+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:57.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.560+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-27T15:23:57.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.560+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-27T15:23:57.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.560+0000 7f1e5dc3eec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-27T15:23:57.573 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.579+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-conf state=0x55cb66e35500 s->prefetch_data=0 2019-11-27T15:23:57.573 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.579+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-27T15:23:57.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-27T15:23:57.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T15:23:57.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:57.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:23:57.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-27T15:23:57.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.589+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:57.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.600+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-27T15:23:57.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.600+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-27T15:23:57.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.600+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T15:23:57.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.600+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 state=0x55cb66e37ad0 s->prefetch_data=0 2019-11-27T15:23:57.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.600+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 : miss 2019-11-27T15:23:57.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 info.flags=0x16 2019-11-27T15:23:57.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 to cache LRU end 2019-11-27T15:23:57.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:23:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.613+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:23:57.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-27T15:23:57.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 info.flags=0x13 2019-11-27T15:23:57.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 to cache LRU end 2019-11-27T15:23:57.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:57.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:23:57.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.627+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:57.639 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.645+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-conf[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1]) start [] num_entries 1100 2019-11-27T15:23:57.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-27T15:23:57.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-27T15:23:57.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-27T15:23:57.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.664+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-27T15:23:57.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.665+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.676+0000 7f1e5dc3eec0 10 manifest: total_size = 5945 2019-11-27T15:23:57.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.676+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.13 2019-11-27T15:23:57.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.676+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.676+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:57.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.676+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:57.784 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.791+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.803+0000 7f1e5dc3eec0 10 manifest: total_size = 3888 2019-11-27T15:23:57.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.803+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.30 2019-11-27T15:23:57.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.803+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.803+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:57.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.803+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:57.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.978+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.996+0000 7f1e5dc3eec0 10 manifest: total_size = 5786 2019-11-27T15:23:57.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.996+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.56 2019-11-27T15:23:57.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.996+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:57.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.996+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:57.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:57.996+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.184+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.196+0000 7f1e5dc3eec0 10 manifest: total_size = 5814 2019-11-27T15:23:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.196+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.72 2019-11-27T15:23:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.196+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.196+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.196+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:58.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.315+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.334+0000 7f1e5dc3eec0 10 manifest: total_size = 5965 2019-11-27T15:23:58.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.334+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.87 2019-11-27T15:23:58.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.334+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.334+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:58.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.334+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:58.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.517+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.531+0000 7f1e5dc3eec0 10 manifest: total_size = 6050 2019-11-27T15:23:58.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.531+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.120 2019-11-27T15:23:58.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.531+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.531+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:58.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.531+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:58.726 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.733+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.744+0000 7f1e5dc3eec0 10 manifest: total_size = 6186 2019-11-27T15:23:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.744+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.190 2019-11-27T15:23:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.744+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55cb66e3ccb8 s->prefetch_data=0 2019-11-27T15:23:58.738 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.744+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3ccb8 2019-11-27T15:23:58.738 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.744+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:58.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.895+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55cb66e43b58 s->prefetch_data=0 2019-11-27T15:23:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.904+0000 7f1e5dc3eec0 10 manifest: total_size = 4025 2019-11-27T15:23:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.904+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.247 2019-11-27T15:23:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.904+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55cb66e43b58 s->prefetch_data=0 2019-11-27T15:23:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.904+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e43b58 2019-11-27T15:23:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:58.904+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:59.053 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.059+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55cb66e43b58 s->prefetch_data=0 2019-11-27T15:23:59.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.077+0000 7f1e5dc3eec0 10 manifest: total_size = 29176 2019-11-27T15:23:59.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.077+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.323 2019-11-27T15:23:59.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.077+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55cb66e43b58 s->prefetch_data=0 2019-11-27T15:23:59.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.077+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e43b58 2019-11-27T15:23:59.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.077+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 2019-11-27T15:23:59.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.246+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-conf[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1]) start _multipart_[] num_entries 1001 2019-11-27T15:23:59.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.246+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:23:59.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.361+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1])"; objs.size()=0; is_truncated=0 2019-11-27T15:23:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.445+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-conf state=0x55cb66e3e170 s->prefetch_data=0 2019-11-27T15:23:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.445+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-27T15:23:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-27T15:23:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-27T15:23:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:23:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:23:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-27T15:23:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-27T15:23:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.459+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-27T15:23:59.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.503+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683072 cookie 94332092247360 notifier 4478 bl.length()=162 2019-11-27T15:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.853+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.1 from cache 2019-11-27T15:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.853+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=219 2019-11-27T15:23:59.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:23:59.897+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683072 cookie 94332092291552 notifier 4478 bl.length()=219 2019-11-27T15:24:00.157 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.163+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:00.157 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.163+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-27T15:24:00.170 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-27T15:24:00.170 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T15:24:00.170 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:00.170 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:00.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:00.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.176+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:00.180 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.187+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-27T15:24:00.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.187+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-27T15:24:00.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.187+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T15:24:00.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.187+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 state=0x55cb66e376d0 s->prefetch_data=0 2019-11-27T15:24:00.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.187+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 : miss 2019-11-27T15:24:00.191 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 info.flags=0x16 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 to cache LRU end 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:00.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:00.193 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.198+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:00.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-27T15:24:00.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 info.flags=0x13 2019-11-27T15:24:00.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 to cache LRU end 2019-11-27T15:24:00.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:00.214 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:00.215 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.219+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 2019-11-27T15:24:00.228 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.234+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2]) start [] num_entries 1100 2019-11-27T15:24:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.252+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T15:24:00.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.252+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55cb66e3cc28 s->prefetch_data=0 2019-11-27T15:24:00.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.260+0000 7f1e5dc3eec0 10 manifest: total_size = 26079 2019-11-27T15:24:00.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.260+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.20 2019-11-27T15:24:00.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.260+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55cb66e3cc28 s->prefetch_data=0 2019-11-27T15:24:00.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.260+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3cc28 2019-11-27T15:24:00.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.260+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 2019-11-27T15:24:00.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2019-11-27T15:24:00.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2019-11-27T15:24:00.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2019-11-27T15:24:00.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7671 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7670 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7670 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2019-11-27T15:24:00.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4217316 part_ofs=23012 rule->part_size=3067 2019-11-27T15:24:00.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2019-11-27T15:24:00.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.334+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.20 2019-11-27T15:24:00.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.412+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2]) start _multipart_[] num_entries 1001 2019-11-27T15:24:00.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.412+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:00.420 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.426+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:00.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.480+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:00.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.480+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:00.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-27T15:24:00.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-27T15:24:00.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:00.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:00.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:00.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-27T15:24:00.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.491+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-27T15:24:00.495 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:00.501+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94332092250816 notifier 4478 bl.length()=191 2019-11-27T15:24:01.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.031+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2 from cache 2019-11-27T15:24:01.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.031+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=248 2019-11-27T15:24:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.054+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94332092254320 notifier 4478 bl.length()=248 2019-11-27T15:24:01.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.305+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:01.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.305+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-27T15:24:01.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-27T15:24:01.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T15:24:01.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:01.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:01.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:01.315 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.320+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:01.333 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.339+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-27T15:24:01.333 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.339+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-27T15:24:01.333 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.339+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T15:24:01.333 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.339+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 state=0x55cb66e3e170 s->prefetch_data=0 2019-11-27T15:24:01.333 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.339+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 : miss 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 info.flags=0x16 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 to cache LRU end 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:01.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:01.358 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:01.358 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:01.358 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.363+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:01.384 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.390+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-27T15:24:01.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.391+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 info.flags=0x13 2019-11-27T15:24:01.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.391+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 to cache LRU end 2019-11-27T15:24:01.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.391+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:01.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.391+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:01.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.391+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 2019-11-27T15:24:01.399 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.406+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3]) start [] num_entries 1100 2019-11-27T15:24:01.419 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.426+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T15:24:01.419 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.426+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55cb66e3cc28 s->prefetch_data=0 2019-11-27T15:24:01.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.441+0000 7f1e5dc3eec0 10 manifest: total_size = 74198 2019-11-27T15:24:01.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.441+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.40 2019-11-27T15:24:01.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.441+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55cb66e3cc28 s->prefetch_data=0 2019-11-27T15:24:01.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.441+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3cc28 2019-11-27T15:24:01.436 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.441+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 2019-11-27T15:24:01.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-27T15:24:01.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-27T15:24:01.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.556+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.40 2019-11-27T15:24:01.637 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.643+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3]) start _multipart_[] num_entries 1001 2019-11-27T15:24:01.637 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.643+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:01.657 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.663+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:01.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.738+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:01.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.738+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:01.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-27T15:24:01.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.752+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-27T15:24:01.755 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:01.762+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94332092254320 notifier 4478 bl.length()=198 2019-11-27T15:24:02.225 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.231+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3 from cache 2019-11-27T15:24:02.225 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.231+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=255 2019-11-27T15:24:02.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.246+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94332092250816 notifier 4478 bl.length()=255 2019-11-27T15:24:02.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.532+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55cb66e3de00 s->prefetch_data=0 2019-11-27T15:24:02.526 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.532+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-27T15:24:02.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-27T15:24:02.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T15:24:02.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.547+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:02.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.563+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-27T15:24:02.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.563+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-27T15:24:02.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.563+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T15:24:02.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.563+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:02.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.563+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 : miss 2019-11-27T15:24:02.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 info.flags=0x16 2019-11-27T15:24:02.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 to cache LRU end 2019-11-27T15:24:02.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:02.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:02.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:02.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:02.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:02.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:02.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.577+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:02.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-27T15:24:02.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 info.flags=0x13 2019-11-27T15:24:02.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 to cache LRU end 2019-11-27T15:24:02.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:02.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:02.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.599+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:02.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.621+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4]) start [] num_entries 1100 2019-11-27T15:24:02.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.682+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo[8UjN1Tb8-6bbXNhS8IE8uOZ7qx9ZDvW] 2019-11-27T15:24:02.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.682+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:02.698 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.705+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.722+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 5zv9ubcftboz681cn2n3e6xhflk3lomm 2019-11-27T15:24:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.722+0000 7f1e5dc3eec0 20 get_obj_state_impl: setting s->olh_tag to 7dfaj80nofo8efxhqrr3zjsfhy9eln56 2019-11-27T15:24:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.722+0000 7f1e5dc3eec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7dfaj80nofo8efxhqrr3zjsfhy9eln56 2019-11-27T15:24:02.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.783+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:02.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.869+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:02.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.869+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:02.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.887+0000 7f1e5dc3eec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-11-27T15:24:02.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.887+0000 7f1e5dc3eec0 20 olh_log_entry: epoch=3 op=3 key=foo[8UjN1Tb8-6bbXNhS8IE8uOZ7qx9ZDvW] 2019-11-27T15:24:02.881 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.887+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-index-versioning.1:_:8UjN1Tb8-6bbXNhS8IE8uOZ7qx9ZDvW_foo state=0x55cb66e4bdf8 s->prefetch_data=0 2019-11-27T15:24:02.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.905+0000 7f1e5dc3eec0 10 manifest: total_size = 18874368 2019-11-27T15:24:02.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.905+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.55 2019-11-27T15:24:02.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.905+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-index-versioning.1:_:8UjN1Tb8-6bbXNhS8IE8uOZ7qx9ZDvW_foo state=0x55cb66e4bdf8 s->prefetch_data=0 2019-11-27T15:24:02.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.905+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e4bdf8 2019-11-27T15:24:02.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:02.905+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:03.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-11-27T15:24:03.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-11-27T15:24:03.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2019-11-27T15:24:03.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-11-27T15:24:03.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.064+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.55 2019-11-27T15:24:03.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.208+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:03.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.208+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:03.290 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.296+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:03.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.363+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 2019-11-27T15:24:03.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.363+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4]) start _multipart_[] num_entries 1001 2019-11-27T15:24:03.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.363+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:03.389 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.396+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:03.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.467+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:03.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.467+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:03.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-27T15:24:03.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-27T15:24:03.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:03.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:03.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:03.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-27T15:24:03.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.478+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-27T15:24:03.483 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.490+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94332092254320 notifier 4478 bl.length()=193 2019-11-27T15:24:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.687+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4 from cache 2019-11-27T15:24:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.687+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=250 2019-11-27T15:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:03.697+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94332092256192 notifier 4478 bl.length()=250 2019-11-27T15:24:04.046 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.053+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:04.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.053+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:04.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.065+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:04.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.075+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T15:24:04.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.075+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-27T15:24:04.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.075+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T15:24:04.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.075+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 state=0x55cb66e3d470 s->prefetch_data=0 2019-11-27T15:24:04.070 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.075+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 : miss 2019-11-27T15:24:04.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 info.flags=0x16 2019-11-27T15:24:04.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 to cache LRU end 2019-11-27T15:24:04.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:04.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:04.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:04.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:04.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:04.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:04.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.089+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:04.099 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T15:24:04.099 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 info.flags=0x13 2019-11-27T15:24:04.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 to cache LRU end 2019-11-27T15:24:04.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:04.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:04.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.105+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 2019-11-27T15:24:04.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.131+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5]) start [] num_entries 1100 2019-11-27T15:24:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.154+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-27T15:24:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.154+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:04.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.165+0000 7f1e5dc3eec0 10 manifest: total_size = 26085 2019-11-27T15:24:04.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.165+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.71 2019-11-27T15:24:04.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.165+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:04.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.165+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:04.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.166+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 2019-11-27T15:24:04.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2019-11-27T15:24:04.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7672 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7674 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2019-11-27T15:24:04.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=7674 2019-11-27T15:24:04.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=23018 stripe_ofs=23018 part_ofs=23018 rule->part_size=3067 2019-11-27T15:24:04.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2019-11-27T15:24:04.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4217322 part_ofs=23018 rule->part_size=3067 2019-11-27T15:24:04.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=26085 stripe_ofs=26085 part_ofs=26085 rule->part_size=3067 2019-11-27T15:24:04.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.274+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.71 2019-11-27T15:24:04.336 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.343+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5]) start _multipart_[] num_entries 1001 2019-11-27T15:24:04.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.343+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.355+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:04.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.447+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55cb66e3d470 s->prefetch_data=0 2019-11-27T15:24:04.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.447+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:04.463 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-27T15:24:04.463 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-27T15:24:04.463 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:04.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:04.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:04.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-27T15:24:04.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.469+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-27T15:24:04.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:04.480+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94332092271520 notifier 4478 bl.length()=183 2019-11-27T15:24:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.221+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5 from cache 2019-11-27T15:24:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.221+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=240 2019-11-27T15:24:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.236+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683079 cookie 94332092273200 notifier 4478 bl.length()=240 2019-11-27T15:24:05.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.647+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55cb66e3c430 s->prefetch_data=0 2019-11-27T15:24:05.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.647+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:05.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.665+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.679+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-27T15:24:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.679+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-27T15:24:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.679+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T15:24:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.679+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 state=0x55cb66e3d470 s->prefetch_data=0 2019-11-27T15:24:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.679+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 : miss 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 info.flags=0x16 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 to cache LRU end 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:05.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:05.694 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:05.694 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.699+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:05.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-27T15:24:05.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 info.flags=0x13 2019-11-27T15:24:05.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 to cache LRU end 2019-11-27T15:24:05.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:05.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:05.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.724+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:05.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.750+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7]) start [] num_entries 1100 2019-11-27T15:24:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T15:24:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-27T15:24:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-27T15:24:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-27T15:24:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T15:24:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-27T15:24:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.784+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-27T15:24:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.785+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:05.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.793+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:05.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.793+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.108 2019-11-27T15:24:05.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.793+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:05.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.793+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:05.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.793+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:05.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.876+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:05.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.876+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.876+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.876+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.876+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.108 2019-11-27T15:24:05.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.945+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:05.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.953+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:05.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.953+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.109 2019-11-27T15:24:05.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.953+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:05.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.953+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:05.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:05.953+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:06.033 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.039+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.039+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.039+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.039+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.039+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.109 2019-11-27T15:24:06.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.129+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.146+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:06.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.146+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _3hzzyuy5VMUYLn1DGrbVNtoSDkF-nOu 2019-11-27T15:24:06.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.146+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.146+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:06.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.146+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:06.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.261+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.261+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.261+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.261+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.261+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _3hzzyuy5VMUYLn1DGrbVNtoSDkF-nOu 2019-11-27T15:24:06.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.331+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55cb66e42b88 s->prefetch_data=0 2019-11-27T15:24:06.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.343+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:06.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.343+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _sW78xOXPF_an4YiUbU2HMaVCD_pYnoR 2019-11-27T15:24:06.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.343+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55cb66e42b88 s->prefetch_data=0 2019-11-27T15:24:06.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.343+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42b88 2019-11-27T15:24:06.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.343+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:06.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.649+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.649+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.649+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _sW78xOXPF_an4YiUbU2HMaVCD_pYnoR 2019-11-27T15:24:06.734 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.740+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.750+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:06.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.750+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.112 2019-11-27T15:24:06.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.750+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.750+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:06.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.750+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:06.843 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.849+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.844 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.849+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.844 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.849+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:06.844 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.849+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:06.844 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.849+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.112 2019-11-27T15:24:06.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.920+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.925 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.931+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:06.925 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.931+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _9ZBYajnSFiOaVI9FoBvHwK-4m4RNTxP 2019-11-27T15:24:06.925 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.931+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:06.925 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.931+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:06.925 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:06.931+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:07.023 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.029+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:07.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.029+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:07.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.029+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:07.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.029+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:07.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.029+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _9ZBYajnSFiOaVI9FoBvHwK-4m4RNTxP 2019-11-27T15:24:07.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.118+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:07.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.142+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:07.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.142+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.114 2019-11-27T15:24:07.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.142+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:07.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.142+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:07.137 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.142+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:07.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.314+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:07.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.314+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:07.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.314+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:07.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.314+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:07.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.314+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.114 2019-11-27T15:24:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.418+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.434+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.434+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _BT0tz3L1Ixm94z_M7DIl4vd45RBUHGJ 2019-11-27T15:24:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.434+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.434+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:07.429 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.434+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:07.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.696+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:07.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.696+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:07.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.696+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _BT0tz3L1Ixm94z_M7DIl4vd45RBUHGJ 2019-11-27T15:24:07.798 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.805+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55cb66e42c08 s->prefetch_data=0 2019-11-27T15:24:07.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.823+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:07.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.823+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.116 2019-11-27T15:24:07.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.823+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55cb66e42c08 s->prefetch_data=0 2019-11-27T15:24:07.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.823+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42c08 2019-11-27T15:24:07.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:07.823+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:08.022 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.028+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.022 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.028+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.022 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.028+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.116 2019-11-27T15:24:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.102+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.111+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.111+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _Wi10UfDKm1oaxX4DR7r_8Sayoog3qp0 2019-11-27T15:24:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.111+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.111+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.111+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:08.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.208+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.208+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.208+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.208+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.208+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _Wi10UfDKm1oaxX4DR7r_8Sayoog3qp0 2019-11-27T15:24:08.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.264+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55cb66e3f148 s->prefetch_data=0 2019-11-27T15:24:08.265 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.272+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.272+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _cLkjlQEh7xJPKFyxPOiNP-MzuAta8B_ 2019-11-27T15:24:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.272+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55cb66e3f148 s->prefetch_data=0 2019-11-27T15:24:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.272+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3f148 2019-11-27T15:24:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.272+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:08.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.367+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.367+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.367+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.367+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.362 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.367+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _cLkjlQEh7xJPKFyxPOiNP-MzuAta8B_ 2019-11-27T15:24:08.425 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.431+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55cb66e3e788 s->prefetch_data=0 2019-11-27T15:24:08.433 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.440+0000 7f1e5dc3eec0 10 manifest: total_size = 5242880 2019-11-27T15:24:08.433 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.440+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.119 2019-11-27T15:24:08.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.440+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55cb66e3e788 s->prefetch_data=0 2019-11-27T15:24:08.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.440+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e788 2019-11-27T15:24:08.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.440+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 2019-11-27T15:24:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.596+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:08.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.596+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-27T15:24:08.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.596+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.119 2019-11-27T15:24:08.665 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.671+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7]) start _multipart_[] num_entries 1001 2019-11-27T15:24:08.665 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.671+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:08.678 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.684+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:08.772 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.778+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55cb66e3d470 s->prefetch_data=0 2019-11-27T15:24:08.772 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.778+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:08.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-27T15:24:08.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-27T15:24:08.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:08.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:08.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:08.786 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-27T15:24:08.786 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.791+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-27T15:24:08.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:08.808+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683080 cookie 94332092254320 notifier 4478 bl.length()=189 2019-11-27T15:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.147+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7 from cache 2019-11-27T15:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.147+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=246 2019-11-27T15:24:09.155 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.161+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94332092256192 notifier 4478 bl.length()=246 2019-11-27T15:24:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.422+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55cb66e3d470 s->prefetch_data=0 2019-11-27T15:24:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.422+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-27T15:24:09.437 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-27T15:24:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T15:24:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.443+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.486+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.486+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.486+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.486+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.486+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 : miss 2019-11-27T15:24:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 info.flags=0x16 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 to cache LRU end 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.503+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 info.flags=0x13 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 to cache LRU end 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:09.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.524+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:09.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.554+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9]) start [] num_entries 1100 2019-11-27T15:24:09.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T15:24:09.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-27T15:24:09.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T15:24:09.607 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-27T15:24:09.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-27T15:24:09.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-27T15:24:09.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.612+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:09.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.633+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:09.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.633+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.225 2019-11-27T15:24:09.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.633+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55cb66e3e628 s->prefetch_data=0 2019-11-27T15:24:09.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.633+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3e628 2019-11-27T15:24:09.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.633+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:09.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:09.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:09.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:09.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:09.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.782+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.225 2019-11-27T15:24:09.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.848+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55cb66e48588 s->prefetch_data=0 2019-11-27T15:24:09.851 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.857+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:09.851 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.857+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.226 2019-11-27T15:24:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.857+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55cb66e48588 s->prefetch_data=0 2019-11-27T15:24:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.857+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e48588 2019-11-27T15:24:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.857+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:09.982 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:09.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:09.985 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:09.985 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:09.988+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.226 2019-11-27T15:24:10.064 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.070+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55cb66e3f638 s->prefetch_data=0 2019-11-27T15:24:10.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.088+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:10.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.088+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _HAJzMPuL3QZFAmY6B_rVInpG6KxukTz 2019-11-27T15:24:10.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.088+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55cb66e3f638 s->prefetch_data=0 2019-11-27T15:24:10.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.088+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3f638 2019-11-27T15:24:10.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.088+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:10.209 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T15:24:10.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.216+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _HAJzMPuL3QZFAmY6B_rVInpG6KxukTz 2019-11-27T15:24:10.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.291+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55cb66e3f638 s->prefetch_data=0 2019-11-27T15:24:10.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.302+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:10.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.302+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _u37XrsE3XrCw_nYIoj56vvi5H1IK7nq 2019-11-27T15:24:10.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.302+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55cb66e3f638 s->prefetch_data=0 2019-11-27T15:24:10.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.302+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e3f638 2019-11-27T15:24:10.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.302+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:10.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.573+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:10.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.573+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:10.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.573+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:10.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.573+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T15:24:10.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.573+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _u37XrsE3XrCw_nYIoj56vvi5H1IK7nq 2019-11-27T15:24:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.646+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.661+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.661+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.234 2019-11-27T15:24:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.661+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.661+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:10.656 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.661+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:10.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:10.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.781+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.234 2019-11-27T15:24:10.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.844+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.861+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.861+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _IK8-NVcVa3JHEwtT-zxuGz_aZLQlqO5 2019-11-27T15:24:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.861+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.861+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:10.861+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:11.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:11.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:11.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:11.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:11.012 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:11.012 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T15:24:11.012 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.017+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _IK8-NVcVa3JHEwtT-zxuGz_aZLQlqO5 2019-11-27T15:24:11.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.130+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.143 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.149+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:11.143 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.149+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.236 2019-11-27T15:24:11.144 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.149+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.144 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.149+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:11.144 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.149+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.238+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.236 2019-11-27T15:24:11.313 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.319+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.332+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:11.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.332+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _hzFuswlKtRBIjGWLr6OPxAIdxPn4coC 2019-11-27T15:24:11.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.332+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.332+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:11.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.333+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:11.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.598+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:11.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.598+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:11.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.598+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:11.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.598+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-27T15:24:11.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.598+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _hzFuswlKtRBIjGWLr6OPxAIdxPn4coC 2019-11-27T15:24:11.653 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.659+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.677+0000 7f1e5dc3eec0 10 manifest: total_size = 1140 2019-11-27T15:24:11.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.677+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.243 2019-11-27T15:24:11.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.677+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.677+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:11.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.677+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-27T15:24:11.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2019-11-27T15:24:11.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2019-11-27T15:24:11.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=110 2019-11-27T15:24:11.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2019-11-27T15:24:11.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.812+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.243 2019-11-27T15:24:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.875+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.883+0000 7f1e5dc3eec0 10 manifest: total_size = 1140 2019-11-27T15:24:11.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.883+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _KBN0tqxHbhagXoRGgL8rtNR-o-mJ1BU 2019-11-27T15:24:11.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.883+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:11.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.883+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:11.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:11.883+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:12.035 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.041+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:12.035 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.041+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2019-11-27T15:24:12.035 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.041+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _KBN0tqxHbhagXoRGgL8rtNR-o-mJ1BU 2019-11-27T15:24:12.139 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.145+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:12.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.153+0000 7f1e5dc3eec0 10 manifest: total_size = 1140 2019-11-27T15:24:12.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.153+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to _08PLU4wXJiyXTTk9ksa25oJcLF26atN 2019-11-27T15:24:12.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.153+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55cb66e489c8 s->prefetch_data=0 2019-11-27T15:24:12.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.153+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e489c8 2019-11-27T15:24:12.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.153+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.255+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.255+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2019-11-27T15:24:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.255+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _08PLU4wXJiyXTTk9ksa25oJcLF26atN 2019-11-27T15:24:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.296+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55cb66e42ba8 s->prefetch_data=0 2019-11-27T15:24:12.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.304+0000 7f1e5dc3eec0 10 manifest: total_size = 1140 2019-11-27T15:24:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.304+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.246 2019-11-27T15:24:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.304+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55cb66e42ba8 s->prefetch_data=0 2019-11-27T15:24:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.304+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ba8 2019-11-27T15:24:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.304+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.372+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-27T15:24:12.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2019-11-27T15:24:12.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2019-11-27T15:24:12.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=110 2019-11-27T15:24:12.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2019-11-27T15:24:12.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.373+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.246 2019-11-27T15:24:12.419 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.425+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9]) start _multipart_[] num_entries 1001 2019-11-27T15:24:12.419 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.425+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:12.451 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.457+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:12.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.559+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55cb66e47d60 s->prefetch_data=0 2019-11-27T15:24:12.554 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.559+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-27T15:24:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-27T15:24:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-27T15:24:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.574+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-27T15:24:12.581 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.587+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94332092256192 notifier 4478 bl.length()=199 2019-11-27T15:24:12.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.886+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9 from cache 2019-11-27T15:24:12.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.886+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=256 2019-11-27T15:24:12.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:12.896+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94332092271520 notifier 4478 bl.length()=256 2019-11-27T15:24:13.356 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.362+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55cb66e3d8f0 s->prefetch_data=0 2019-11-27T15:24:13.356 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.362+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-27T15:24:13.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-27T15:24:13.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T15:24:13.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:13.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:13.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:13.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.373+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:13.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.384+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-27T15:24:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.384+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-27T15:24:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.384+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T15:24:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.384+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.384+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 : miss 2019-11-27T15:24:13.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 info.flags=0x16 2019-11-27T15:24:13.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 to cache LRU end 2019-11-27T15:24:13.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:13.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:13.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:13.391 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:13.391 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:13.391 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:13.391 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.396+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:13.405 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-27T15:24:13.405 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 info.flags=0x13 2019-11-27T15:24:13.405 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 to cache LRU end 2019-11-27T15:24:13.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:13.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:13.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.411+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 2019-11-27T15:24:13.420 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.426+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8]) start [] num_entries 1100 2019-11-27T15:24:13.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.445+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T15:24:13.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.445+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T15:24:13.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.445+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T15:24:13.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.445+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55cb66e490a8 s->prefetch_data=0 2019-11-27T15:24:13.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.464+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:13.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.464+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.197 2019-11-27T15:24:13.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.464+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55cb66e490a8 s->prefetch_data=0 2019-11-27T15:24:13.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.464+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e490a8 2019-11-27T15:24:13.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.464+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 2019-11-27T15:24:13.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:13.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:13.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:13.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:13.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.553+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.197 2019-11-27T15:24:13.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.661+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55cb66e490a8 s->prefetch_data=0 2019-11-27T15:24:13.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.670+0000 7f1e5dc3eec0 10 manifest: total_size = 11534336 2019-11-27T15:24:13.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.670+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.204 2019-11-27T15:24:13.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.670+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55cb66e490a8 s->prefetch_data=0 2019-11-27T15:24:13.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.670+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e490a8 2019-11-27T15:24:13.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.670+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 2019-11-27T15:24:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-27T15:24:13.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-27T15:24:13.754 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.757+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.204 2019-11-27T15:24:13.821 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.827+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55cb66e42b68 s->prefetch_data=0 2019-11-27T15:24:13.835 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.841+0000 7f1e5dc3eec0 10 manifest: total_size = 541681 2019-11-27T15:24:13.835 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.841+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.211 2019-11-27T15:24:13.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.841+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55cb66e42b68 s->prefetch_data=0 2019-11-27T15:24:13.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.841+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42b68 2019-11-27T15:24:13.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.841+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 2019-11-27T15:24:13.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-27T15:24:13.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-27T15:24:13.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-27T15:24:13.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-11-27T15:24:13.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.928+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.211 2019-11-27T15:24:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.986+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8]) start _multipart_[] num_entries 1001 2019-11-27T15:24:13.981 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:13.986+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.000+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:14.065 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.071+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55cb66e48070 s->prefetch_data=0 2019-11-27T15:24:14.065 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.071+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.093+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-27T15:24:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-27T15:24:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-27T15:24:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.094+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-27T15:24:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.110+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683081 cookie 94332092273200 notifier 4478 bl.length()=194 2019-11-27T15:24:14.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.387+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8 from cache 2019-11-27T15:24:14.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.387+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=251 2019-11-27T15:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.397+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94332092271520 notifier 4478 bl.length()=251 2019-11-27T15:24:14.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.628+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:14.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.628+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-27T15:24:14.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-27T15:24:14.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T15:24:14.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:14.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:14.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:14.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.646+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:14.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.664+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-27T15:24:14.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.664+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-27T15:24:14.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.664+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T15:24:14.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.664+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 state=0x55cb66e3d8f0 s->prefetch_data=0 2019-11-27T15:24:14.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.664+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 : miss 2019-11-27T15:24:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 info.flags=0x16 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 to cache LRU end 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.682+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-27T15:24:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 info.flags=0x13 2019-11-27T15:24:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 to cache LRU end 2019-11-27T15:24:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.702+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 2019-11-27T15:24:14.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.748+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6]) start [] num_entries 1100 2019-11-27T15:24:14.783 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.789+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-27T15:24:14.783 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.789+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-27T15:24:14.783 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.789+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-27T15:24:14.783 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.789+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:14.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.801+0000 7f1e5dc3eec0 10 manifest: total_size = 10485760 2019-11-27T15:24:14.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.801+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.84 2019-11-27T15:24:14.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.801+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:14.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.801+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:14.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.801+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 2019-11-27T15:24:14.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:14.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:14.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:14.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:14.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:14.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-27T15:24:14.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:14.928+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.84 2019-11-27T15:24:15.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.044+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.066+0000 7f1e5dc3eec0 10 manifest: total_size = 10485760 2019-11-27T15:24:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.066+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.85 2019-11-27T15:24:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.066+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.066+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.066+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 2019-11-27T15:24:15.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:15.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-27T15:24:15.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:15.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-27T15:24:15.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-27T15:24:15.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-27T15:24:15.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.181+0000 7f1e5dc3eec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.85 2019-11-27T15:24:15.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.242+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:15.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.251+0000 7f1e5dc3eec0 10 manifest: total_size = 53499 2019-11-27T15:24:15.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.251+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.86 2019-11-27T15:24:15.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.251+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:15.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.251+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:15.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.251+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 2019-11-27T15:24:15.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.337+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6]) start _multipart_[] num_entries 1001 2019-11-27T15:24:15.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.337+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.427+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.531+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.531+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-27T15:24:15.548 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.552+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-27T15:24:15.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.569+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683082 cookie 94332092254320 notifier 4478 bl.length()=184 2019-11-27T15:24:15.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.996+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6 from cache 2019-11-27T15:24:15.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:15.996+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=241 2019-11-27T15:24:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.004+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94332092250816 notifier 4478 bl.length()=241 2019-11-27T15:24:16.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.291+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55cb66e3cbd0 s->prefetch_data=0 2019-11-27T15:24:16.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.291+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.300+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:16.302 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.308+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T15:24:16.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.308+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-27T15:24:16.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.308+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T15:24:16.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.308+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 state=0x55cb66e47e00 s->prefetch_data=0 2019-11-27T15:24:16.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.308+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 : miss 2019-11-27T15:24:16.313 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 info.flags=0x16 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 to cache LRU end 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:16.315 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:16.315 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.319+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 info.flags=0x13 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 to cache LRU end 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.337+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 2019-11-27T15:24:16.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.351+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10]) start [] num_entries 1100 2019-11-27T15:24:16.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.375+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T15:24:16.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.375+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T15:24:16.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.375+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T15:24:16.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.375+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T15:24:16.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.375+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.387+0000 7f1e5dc3eec0 10 manifest: total_size = 110 2019-11-27T15:24:16.382 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.387+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.306 2019-11-27T15:24:16.382 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.387+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.382 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.387+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:16.382 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.388+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 2019-11-27T15:24:16.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.492+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.528+0000 7f1e5dc3eec0 10 manifest: total_size = 1048576 2019-11-27T15:24:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.528+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.308 2019-11-27T15:24:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.528+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.528+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.528+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 2019-11-27T15:24:16.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.699+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.748+0000 7f1e5dc3eec0 10 manifest: total_size = 49187 2019-11-27T15:24:16.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.748+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.307 2019-11-27T15:24:16.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.748+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.748+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:16.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.748+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 2019-11-27T15:24:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.866+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.889+0000 7f1e5dc3eec0 10 manifest: total_size = 49187 2019-11-27T15:24:16.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.889+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.305 2019-11-27T15:24:16.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.889+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:16.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.889+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:16.883 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:16.889+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 2019-11-27T15:24:17.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.041+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10]) start _multipart_[] num_entries 1001 2019-11-27T15:24:17.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.041+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:17.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.108+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:17.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.165+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55cb66e497c0 s->prefetch_data=0 2019-11-27T15:24:17.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.165+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:17.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-27T15:24:17.172 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.178+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T15:24:17.185 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.192+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94332092250816 notifier 4478 bl.length()=181 2019-11-27T15:24:17.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.413+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.10 from cache 2019-11-27T15:24:17.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.413+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-27T15:24:17.432 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.439+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 94332092291552 notifier 4478 bl.length()=239 2019-11-27T15:24:17.731 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.738+0000 7f1e1b7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:24:17.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.984+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55cb66e49b70 s->prefetch_data=0 2019-11-27T15:24:17.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.984+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-27T15:24:17.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-27T15:24:17.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T15:24:17.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:17.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:17.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:17.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:17.992+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:17.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.003+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T15:24:17.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.003+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-27T15:24:17.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.003+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T15:24:17.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.004+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 state=0x55cb66e48070 s->prefetch_data=0 2019-11-27T15:24:17.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.004+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 : miss 2019-11-27T15:24:18.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 info.flags=0x16 2019-11-27T15:24:18.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 to cache LRU end 2019-11-27T15:24:18.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:18.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.030+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T15:24:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 info.flags=0x13 2019-11-27T15:24:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 to cache LRU end 2019-11-27T15:24:18.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:18.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:18.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.045+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 2019-11-27T15:24:18.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.058+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11]) start [] num_entries 1100 2019-11-27T15:24:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.113+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T15:24:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.113+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T15:24:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.113+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T15:24:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.113+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T15:24:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.113+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.132+0000 7f1e5dc3eec0 10 manifest: total_size = 24595 2019-11-27T15:24:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.132+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.313 2019-11-27T15:24:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.132+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.132+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.132+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 2019-11-27T15:24:18.222 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.228+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.239+0000 7f1e5dc3eec0 10 manifest: total_size = 62 2019-11-27T15:24:18.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.239+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.315 2019-11-27T15:24:18.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.239+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.239+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:18.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.239+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 2019-11-27T15:24:18.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.374+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.382+0000 7f1e5dc3eec0 10 manifest: total_size = 2078 2019-11-27T15:24:18.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.382+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.314 2019-11-27T15:24:18.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.382+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.382+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:18.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.383+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 2019-11-27T15:24:18.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.517+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.528+0000 7f1e5dc3eec0 10 manifest: total_size = 527 2019-11-27T15:24:18.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.528+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.312 2019-11-27T15:24:18.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.528+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:18.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.528+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:18.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.528+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 2019-11-27T15:24:18.637 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.643+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11]) start _multipart_[] num_entries 1001 2019-11-27T15:24:18.637 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.643+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:18.708 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.714+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:18.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.774+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55cb66e48070 s->prefetch_data=0 2019-11-27T15:24:18.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.774+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:18.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-27T15:24:18.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-27T15:24:18.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:18.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:18.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:18.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-27T15:24:18.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.793+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T15:24:18.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.809+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94332092250816 notifier 4478 bl.length()=181 2019-11-27T15:24:18.934 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.940+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.11 from cache 2019-11-27T15:24:18.934 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.940+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-27T15:24:18.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:18.959+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94332092291552 notifier 4478 bl.length()=239 2019-11-27T15:24:19.577 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.583+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55cb66e49b70 s->prefetch_data=0 2019-11-27T15:24:19.577 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.583+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-27T15:24:19.595 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-27T15:24:19.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T15:24:19.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:19.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:19.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-27T15:24:19.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.601+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.620+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-27T15:24:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.620+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-27T15:24:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.620+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T15:24:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.620+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2ff00 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 state=0x55cb66e42b10 s->prefetch_data=0 2019-11-27T15:24:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.620+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 : miss 2019-11-27T15:24:19.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 info.flags=0x16 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 to cache LRU end 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.acl 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 20 Read xattr: user.rgw.idtag 2019-11-27T15:24:19.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 : type miss (requested=0x13, cached=0x16) 2019-11-27T15:24:19.631 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.635+0000 7f1e5dc3eec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-27T15:24:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 info.flags=0x13 2019-11-27T15:24:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 to cache LRU end 2019-11-27T15:24:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-27T15:24:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.657+0000 7f1e5dc3eec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 2019-11-27T15:24:19.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.676+0000 7f1e5dc3eec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12]) start [] num_entries 1100 2019-11-27T15:24:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.717+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-27T15:24:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.717+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-27T15:24:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.717+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-27T15:24:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.717+0000 7f1e5dc3eec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-27T15:24:19.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.717+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:19.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.739+0000 7f1e5dc3eec0 10 manifest: total_size = 0 2019-11-27T15:24:19.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.739+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.320 2019-11-27T15:24:19.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.739+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:19.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.739+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:19.734 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.739+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 2019-11-27T15:24:19.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.854+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.865+0000 7f1e5dc3eec0 10 manifest: total_size = 0 2019-11-27T15:24:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.865+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.322 2019-11-27T15:24:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.865+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.865+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:19.865+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 2019-11-27T15:24:20.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.031+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.054+0000 7f1e5dc3eec0 10 manifest: total_size = 0 2019-11-27T15:24:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.054+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.321 2019-11-27T15:24:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.054+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.054+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.055+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 2019-11-27T15:24:20.186 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.192+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.205+0000 7f1e5dc3eec0 10 manifest: total_size = 0 2019-11-27T15:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.205+0000 7f1e5dc3eec0 20 get_obj_state: setting s->obj_tag to 52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.319 2019-11-27T15:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.205+0000 7f1e5dc3eec0 20 get_obj_state: rctx=0x7ffc31d2ff20 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55cb66e42ed8 s->prefetch_data=0 2019-11-27T15:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.205+0000 7f1e5dc3eec0 20 prepare_atomic_modification: state is not atomic. state=0x55cb66e42ed8 2019-11-27T15:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.205+0000 7f1e5dc3eec0 20 bucket index object: default.rgw.buckets.index:.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 2019-11-27T15:24:20.401 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.407+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12]) start _multipart_[] num_entries 1001 2019-11-27T15:24:20.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.407+0000 7f1e5dc3eec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-27T15:24:20.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.517+0000 7f1e5dc3eec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12])"; objs.size()=0; is_truncated=0 2019-11-27T15:24:20.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.626+0000 7f1e5dc3eec0 20 get_system_obj_state: rctx=0x7ffc31d2f8b8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55cb66e48ce0 s->prefetch_data=0 2019-11-27T15:24:20.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.626+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-27T15:24:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-27T15:24:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-27T15:24:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T15:24:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T15:24:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-27T15:24:20.639 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-27T15:24:20.639 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.643+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-27T15:24:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:20.664+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683079 cookie 94332092250816 notifier 4478 bl.length()=181 2019-11-27T15:24:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.110+0000 7f1e5dc3eec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.12 from cache 2019-11-27T15:24:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.110+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-27T15:24:21.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.131+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94332092291552 notifier 4478 bl.length()=239 2019-11-27T15:24:21.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.591+0000 7f1e5dc3eec0 10 removing key index: ZBQUHWHIWWFRXEJQTSRE 2019-11-27T15:24:21.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.591+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-11-27T15:24:21.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.602+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683083 cookie 94332092273200 notifier 4478 bl.length()=170 2019-11-27T15:24:21.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.984+0000 7f1e5dc3eec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-27T15:24:21.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:21.984+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-27T15:24:21.996 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.002+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683084 cookie 94332092254320 notifier 4478 bl.length()=182 2019-11-27T15:24:22.396 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.401+0000 7f1e5dc3eec0 10 removing user buckets index 2019-11-27T15:24:22.396 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.401+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-27T15:24:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.415+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683085 cookie 94332092273200 notifier 4478 bl.length()=173 2019-11-27T15:24:22.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.828+0000 7f1e5dc3eec0 10 removing user index: ragweed.client.0 2019-11-27T15:24:22.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.828+0000 7f1e5dc3eec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-27T15:24:22.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.828+0000 7f1e5dc3eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-27T15:24:22.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:22.840+0000 7f1e2bfff700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94332092271520 notifier 4478 bl.length()=165 2019-11-27T15:24:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.462+0000 7f1e5dc3eec0 20 remove_watcher() i=0 2019-11-27T15:24:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.462+0000 7f1e5dc3eec0 2 removed watcher, disabling cache 2019-11-27T15:24:23.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.510+0000 7f1e5dc3eec0 20 remove_watcher() i=1 2019-11-27T15:24:23.547 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.552+0000 7f1e5dc3eec0 20 remove_watcher() i=2 2019-11-27T15:24:23.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.631+0000 7f1e5dc3eec0 20 remove_watcher() i=3 2019-11-27T15:24:23.672 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.678+0000 7f1e5dc3eec0 20 remove_watcher() i=4 2019-11-27T15:24:23.714 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.720+0000 7f1e5dc3eec0 20 remove_watcher() i=5 2019-11-27T15:24:23.780 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.786+0000 7f1e5dc3eec0 20 remove_watcher() i=6 2019-11-27T15:24:23.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:23.856+0000 7f1e5dc3eec0 20 remove_watcher() i=7 2019-11-27T15:24:23.863 INFO:tasks.ragweed:Removing ragweed... 2019-11-27T15:24:23.863 INFO:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-27T15:24:23.957 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-27T15:24:24.359 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-27T15:24:24.360 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-27T15:24:24.360 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-27T15:24:24.360 INFO:teuthology.orchestra.run.smithi156:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-27T15:24:24.417 INFO:teuthology.orchestra.run.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-27T15:24:28.380 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-27T15:24:28.380 INFO:teuthology.orchestra.run.smithi156:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-27T15:24:30.778 INFO:teuthology.orchestra.run.smithi156.stdout: Gradle will be installed under /opt/gradle 2019-11-27T15:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:--2019-11-27 15:24:30-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-27T15:24:30.859 INFO:teuthology.orchestra.run.smithi156.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2019-11-27T15:24:30.867 INFO:teuthology.orchestra.run.smithi156.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-11-27T15:24:30.902 INFO:teuthology.orchestra.run.smithi156.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-27T15:24:30.902 INFO:teuthology.orchestra.run.smithi156.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-27T15:24:30.903 INFO:teuthology.orchestra.run.smithi156.stderr:--2019-11-27 15:24:30-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-27T15:24:30.914 INFO:teuthology.orchestra.run.smithi156.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.159.20, 104.17.160.20, 2606:4700::6811:a014, ... 2019-11-27T15:24:30.922 INFO:teuthology.orchestra.run.smithi156.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.159.20|:443... connected. 2019-11-27T15:24:30.967 INFO:teuthology.orchestra.run.smithi156.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-27T15:24:30.967 INFO:teuthology.orchestra.run.smithi156.stderr:Length: 75323957 (72M) [application/zip] 2019-11-27T15:24:30.967 INFO:teuthology.orchestra.run.smithi156.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-27T15:24:30.968 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T15:24:30.975 INFO:teuthology.orchestra.run.smithi156.stderr: 0K .......... .......... .......... .......... .......... 0% 6.81M 11s 2019-11-27T15:24:30.976 INFO:teuthology.orchestra.run.smithi156.stderr: 50K .......... .......... .......... .......... .......... 0% 109M 6s 2019-11-27T15:24:30.980 INFO:teuthology.orchestra.run.smithi156.stderr: 100K .......... .......... .......... .......... .......... 0% 7.19M 7s 2019-11-27T15:24:30.984 INFO:teuthology.orchestra.run.smithi156.stderr: 150K .......... .......... .......... .......... .......... 0% 113M 5s 2019-11-27T15:24:30.985 INFO:teuthology.orchestra.run.smithi156.stderr: 200K .......... .......... .......... .......... .......... 0% 161M 4s 2019-11-27T15:24:30.985 INFO:teuthology.orchestra.run.smithi156.stderr: 250K .......... .......... .......... .......... .......... 0% 86.2M 4s 2019-11-27T15:24:30.997 INFO:teuthology.orchestra.run.smithi156.stderr: 300K .......... .......... .......... .......... .......... 0% 7.66M 5s 2019-11-27T15:24:30.997 INFO:teuthology.orchestra.run.smithi156.stderr: 350K .......... .......... .......... .......... .......... 0% 88.0M 4s 2019-11-27T15:24:30.997 INFO:teuthology.orchestra.run.smithi156.stderr: 400K .......... .......... .......... .......... .......... 0% 108M 4s 2019-11-27T15:24:30.998 INFO:teuthology.orchestra.run.smithi156.stderr: 450K .......... .......... .......... .......... .......... 0% 105M 3s 2019-11-27T15:24:30.998 INFO:teuthology.orchestra.run.smithi156.stderr: 500K .......... .......... .......... .......... .......... 0% 93.2M 3s 2019-11-27T15:24:30.998 INFO:teuthology.orchestra.run.smithi156.stderr: 550K .......... .......... .......... .......... .......... 0% 109M 3s 2019-11-27T15:24:30.998 INFO:teuthology.orchestra.run.smithi156.stderr: 600K .......... .......... .......... .......... .......... 0% 9.82M 3s 2019-11-27T15:24:32.339 INFO:teuthology.orchestra.run.smithi156.stderr: 650K .......... .......... .......... .......... .......... 0% 102M 3s 2019-11-27T15:24:32.339 INFO:teuthology.orchestra.run.smithi156.stderr: 700K .......... .......... .......... .......... .......... 1% 86.3M 3s 2019-11-27T15:24:32.339 INFO:teuthology.orchestra.run.smithi156.stderr: 750K .......... .......... .......... .......... .......... 1% 72.3M 3s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 800K .......... .......... .......... .......... .......... 1% 86.5M 3s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 850K .......... .......... .......... .......... .......... 1% 134M 3s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 900K .......... .......... .......... .......... .......... 1% 197M 2s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 950K .......... .......... .......... .......... .......... 1% 181M 2s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 1000K .......... .......... .......... .......... .......... 1% 174M 2s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 1050K .......... .......... .......... .......... .......... 1% 201M 2s 2019-11-27T15:24:32.340 INFO:teuthology.orchestra.run.smithi156.stderr: 1100K .......... .......... .......... .......... .......... 1% 192M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1150K .......... .......... .......... .......... .......... 1% 148M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1200K .......... .......... .......... .......... .......... 1% 16.2M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1250K .......... .......... .......... .......... .......... 1% 183M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1300K .......... .......... .......... .......... .......... 1% 128M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1350K .......... .......... .......... .......... .......... 1% 114M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1400K .......... .......... .......... .......... .......... 1% 130M 2s 2019-11-27T15:24:32.341 INFO:teuthology.orchestra.run.smithi156.stderr: 1450K .......... .......... .......... .......... .......... 2% 177M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1500K .......... .......... .......... .......... .......... 2% 110M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1550K .......... .......... .......... .......... .......... 2% 115M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1600K .......... .......... .......... .......... .......... 2% 141M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1650K .......... .......... .......... .......... .......... 2% 145M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1700K .......... .......... .......... .......... .......... 2% 144M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1750K .......... .......... .......... .......... .......... 2% 155M 2s 2019-11-27T15:24:32.342 INFO:teuthology.orchestra.run.smithi156.stderr: 1800K .......... .......... .......... .......... .......... 2% 161M 2s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 1850K .......... .......... .......... .......... .......... 2% 196M 2s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 1900K .......... .......... .......... .......... .......... 2% 153M 2s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 1950K .......... .......... .......... .......... .......... 2% 140M 2s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 2000K .......... .......... .......... .......... .......... 2% 221M 1s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 2050K .......... .......... .......... .......... .......... 2% 192M 1s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 2100K .......... .......... .......... .......... .......... 2% 218M 1s 2019-11-27T15:24:32.343 INFO:teuthology.orchestra.run.smithi156.stderr: 2150K .......... .......... .......... .......... .......... 2% 128M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2200K .......... .......... .......... .......... .......... 3% 193M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2250K .......... .......... .......... .......... .......... 3% 202M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2300K .......... .......... .......... .......... .......... 3% 133M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2350K .......... .......... .......... .......... .......... 3% 194M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2400K .......... .......... .......... .......... .......... 3% 194M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2450K .......... .......... .......... .......... .......... 3% 214M 1s 2019-11-27T15:24:32.344 INFO:teuthology.orchestra.run.smithi156.stderr: 2500K .......... .......... .......... .......... .......... 3% 208M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2550K .......... .......... .......... .......... .......... 3% 180M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2600K .......... .......... .......... .......... .......... 3% 217M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2650K .......... .......... .......... .......... .......... 3% 219M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2700K .......... .......... .......... .......... .......... 3% 213M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2750K .......... .......... .......... .......... .......... 3% 191M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2800K .......... .......... .......... .......... .......... 3% 228M 1s 2019-11-27T15:24:32.345 INFO:teuthology.orchestra.run.smithi156.stderr: 2850K .......... .......... .......... .......... .......... 3% 209M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 2900K .......... .......... .......... .......... .......... 4% 101M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 2950K .......... .......... .......... .......... .......... 4% 188M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 3000K .......... .......... .......... .......... .......... 4% 190M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 3050K .......... .......... .......... .......... .......... 4% 216M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 3100K .......... .......... .......... .......... .......... 4% 211M 1s 2019-11-27T15:24:32.346 INFO:teuthology.orchestra.run.smithi156.stderr: 3150K .......... .......... .......... .......... .......... 4% 187M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3200K .......... .......... .......... .......... .......... 4% 219M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3250K .......... .......... .......... .......... .......... 4% 216M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3300K .......... .......... .......... .......... .......... 4% 211M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3350K .......... .......... .......... .......... .......... 4% 180M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3400K .......... .......... .......... .......... .......... 4% 218M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3450K .......... .......... .......... .......... .......... 4% 220M 1s 2019-11-27T15:24:32.347 INFO:teuthology.orchestra.run.smithi156.stderr: 3500K .......... .......... .......... .......... .......... 4% 209M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3550K .......... .......... .......... .......... .......... 4% 170M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3600K .......... .......... .......... .......... .......... 4% 163M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3650K .......... .......... .......... .......... .......... 5% 168M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3700K .......... .......... .......... .......... .......... 5% 197M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3750K .......... .......... .......... .......... .......... 5% 188M 1s 2019-11-27T15:24:32.348 INFO:teuthology.orchestra.run.smithi156.stderr: 3800K .......... .......... .......... .......... .......... 5% 216M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 3850K .......... .......... .......... .......... .......... 5% 211M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 3900K .......... .......... .......... .......... .......... 5% 196M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 3950K .......... .......... .......... .......... .......... 5% 188M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 4000K .......... .......... .......... .......... .......... 5% 224M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 4050K .......... .......... .......... .......... .......... 5% 160M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 4100K .......... .......... .......... .......... .......... 5% 187M 1s 2019-11-27T15:24:32.349 INFO:teuthology.orchestra.run.smithi156.stderr: 4150K .......... .......... .......... .......... .......... 5% 192M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4200K .......... .......... .......... .......... .......... 5% 214M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4250K .......... .......... .......... .......... .......... 5% 209M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4300K .......... .......... .......... .......... .......... 5% 221M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4350K .......... .......... .......... .......... .......... 5% 191M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4400K .......... .......... .......... .......... .......... 6% 222M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4450K .......... .......... .......... .......... .......... 6% 218M 1s 2019-11-27T15:24:32.350 INFO:teuthology.orchestra.run.smithi156.stderr: 4500K .......... .......... .......... .......... .......... 6% 218M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4550K .......... .......... .......... .......... .......... 6% 198M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4600K .......... .......... .......... .......... .......... 6% 177M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4650K .......... .......... .......... .......... .......... 6% 172M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4700K .......... .......... .......... .......... .......... 6% 170M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4750K .......... .......... .......... .......... .......... 6% 166M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4800K .......... .......... .......... .......... .......... 6% 235M 1s 2019-11-27T15:24:32.351 INFO:teuthology.orchestra.run.smithi156.stderr: 4850K .......... .......... .......... .......... .......... 6% 223M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 4900K .......... .......... .......... .......... .......... 6% 216M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 4950K .......... .......... .......... .......... .......... 6% 188M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 5000K .......... .......... .......... .......... .......... 6% 221M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 5050K .......... .......... .......... .......... .......... 6% 220M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 5100K .......... .......... .......... .......... .......... 7% 212M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 5150K .......... .......... .......... .......... .......... 7% 187M 1s 2019-11-27T15:24:32.352 INFO:teuthology.orchestra.run.smithi156.stderr: 5200K .......... .......... .......... .......... .......... 7% 190M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5250K .......... .......... .......... .......... .......... 7% 162M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5300K .......... .......... .......... .......... .......... 7% 168M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5350K .......... .......... .......... .......... .......... 7% 133M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5400K .......... .......... .......... .......... .......... 7% 182M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5450K .......... .......... .......... .......... .......... 7% 195M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5500K .......... .......... .......... .......... .......... 7% 208M 1s 2019-11-27T15:24:32.353 INFO:teuthology.orchestra.run.smithi156.stderr: 5550K .......... .......... .......... .......... .......... 7% 180M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5600K .......... .......... .......... .......... .......... 7% 196M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5650K .......... .......... .......... .......... .......... 7% 194M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5700K .......... .......... .......... .......... .......... 7% 212M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5750K .......... .......... .......... .......... .......... 7% 197M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5800K .......... .......... .......... .......... .......... 7% 222M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5850K .......... .......... .......... .......... .......... 8% 145M 1s 2019-11-27T15:24:32.354 INFO:teuthology.orchestra.run.smithi156.stderr: 5900K .......... .......... .......... .......... .......... 8% 211M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 5950K .......... .......... .......... .......... .......... 8% 175M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6000K .......... .......... .......... .......... .......... 8% 230M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6050K .......... .......... .......... .......... .......... 8% 232M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6100K .......... .......... .......... .......... .......... 8% 229M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6150K .......... .......... .......... .......... .......... 8% 203M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6200K .......... .......... .......... .......... .......... 8% 234M 1s 2019-11-27T15:24:32.355 INFO:teuthology.orchestra.run.smithi156.stderr: 6250K .......... .......... .......... .......... .......... 8% 246M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6300K .......... .......... .......... .......... .......... 8% 203M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6350K .......... .......... .......... .......... .......... 8% 125M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6400K .......... .......... .......... .......... .......... 8% 171M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6450K .......... .......... .......... .......... .......... 8% 164M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6500K .......... .......... .......... .......... .......... 8% 168M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6550K .......... .......... .......... .......... .......... 8% 152M 1s 2019-11-27T15:24:32.356 INFO:teuthology.orchestra.run.smithi156.stderr: 6600K .......... .......... .......... .......... .......... 9% 162M 1s 2019-11-27T15:24:32.357 INFO:teuthology.orchestra.run.smithi156.stderr: 6650K .......... .......... .......... .......... .......... 9% 163M 1s 2019-11-27T15:24:32.357 INFO:teuthology.orchestra.run.smithi156.stderr: 6700K .......... .......... .......... .......... .......... 9% 150M 1s 2019-11-27T15:24:32.357 INFO:teuthology.orchestra.run.smithi156.stderr: 6750K .......... .......... .......... .......... .......... 9% 127M 1s 2019-11-27T15:24:32.357 INFO:teuthology.orchestra.run.smithi156.stderr: 6800K .......... .......... .......... .......... .......... 9% 158M 1s 2019-11-27T15:24:32.357 INFO:teuthology.orchestra.run.smithi156.stderr: 6850K .......... .......... .......... .......... .......... 9% 156M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 6900K .......... .......... .......... .......... .......... 9% 160M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 6950K .......... .......... .......... .......... .......... 9% 116M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 7000K .......... .......... .......... .......... .......... 9% 139M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 7050K .......... .......... .......... .......... .......... 9% 157M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 7100K .......... .......... .......... .......... .......... 9% 160M 1s 2019-11-27T15:24:32.358 INFO:teuthology.orchestra.run.smithi156.stderr: 7150K .......... .......... .......... .......... .......... 9% 131M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7200K .......... .......... .......... .......... .......... 9% 164M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7250K .......... .......... .......... .......... .......... 9% 208M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7300K .......... .......... .......... .......... .......... 9% 207M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7350K .......... .......... .......... .......... .......... 10% 178M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7400K .......... .......... .......... .......... .......... 10% 206M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7450K .......... .......... .......... .......... .......... 10% 203M 1s 2019-11-27T15:24:32.359 INFO:teuthology.orchestra.run.smithi156.stderr: 7500K .......... .......... .......... .......... .......... 10% 201M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7550K .......... .......... .......... .......... .......... 10% 169M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7600K .......... .......... .......... .......... .......... 10% 207M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7650K .......... .......... .......... .......... .......... 10% 208M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7700K .......... .......... .......... .......... .......... 10% 207M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7750K .......... .......... .......... .......... .......... 10% 171M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7800K .......... .......... .......... .......... .......... 10% 210M 1s 2019-11-27T15:24:32.360 INFO:teuthology.orchestra.run.smithi156.stderr: 7850K .......... .......... .......... .......... .......... 10% 209M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 7900K .......... .......... .......... .......... .......... 10% 212M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 7950K .......... .......... .......... .......... .......... 10% 176M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 8000K .......... .......... .......... .......... .......... 10% 216M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 8050K .......... .......... .......... .......... .......... 11% 202M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 8100K .......... .......... .......... .......... .......... 11% 217M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 8150K .......... .......... .......... .......... .......... 11% 193M 1s 2019-11-27T15:24:32.361 INFO:teuthology.orchestra.run.smithi156.stderr: 8200K .......... .......... .......... .......... .......... 11% 213M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8250K .......... .......... .......... .......... .......... 11% 214M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8300K .......... .......... .......... .......... .......... 11% 210M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8350K .......... .......... .......... .......... .......... 11% 179M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8400K .......... .......... .......... .......... .......... 11% 210M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8450K .......... .......... .......... .......... .......... 11% 193M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8500K .......... .......... .......... .......... .......... 11% 186M 1s 2019-11-27T15:24:32.362 INFO:teuthology.orchestra.run.smithi156.stderr: 8550K .......... .......... .......... .......... .......... 11% 181M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8600K .......... .......... .......... .......... .......... 11% 201M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8650K .......... .......... .......... .......... .......... 11% 198M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8700K .......... .......... .......... .......... .......... 11% 211M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8750K .......... .......... .......... .......... .......... 11% 165M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8800K .......... .......... .......... .......... .......... 12% 219M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8850K .......... .......... .......... .......... .......... 12% 167M 1s 2019-11-27T15:24:32.363 INFO:teuthology.orchestra.run.smithi156.stderr: 8900K .......... .......... .......... .......... .......... 12% 178M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 8950K .......... .......... .......... .......... .......... 12% 198M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 9000K .......... .......... .......... .......... .......... 12% 158M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 9050K .......... .......... .......... .......... .......... 12% 209M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 9100K .......... .......... .......... .......... .......... 12% 217M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 9150K .......... .......... .......... .......... .......... 12% 181M 1s 2019-11-27T15:24:32.364 INFO:teuthology.orchestra.run.smithi156.stderr: 9200K .......... .......... .......... .......... .......... 12% 208M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9250K .......... .......... .......... .......... .......... 12% 206M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9300K .......... .......... .......... .......... .......... 12% 218M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9350K .......... .......... .......... .......... .......... 12% 194M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9400K .......... .......... .......... .......... .......... 12% 213M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9450K .......... .......... .......... .......... .......... 12% 208M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9500K .......... .......... .......... .......... .......... 12% 217M 1s 2019-11-27T15:24:32.365 INFO:teuthology.orchestra.run.smithi156.stderr: 9550K .......... .......... .......... .......... .......... 13% 181M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9600K .......... .......... .......... .......... .......... 13% 223M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9650K .......... .......... .......... .......... .......... 13% 206M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9700K .......... .......... .......... .......... .......... 13% 209M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9750K .......... .......... .......... .......... .......... 13% 199M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9800K .......... .......... .......... .......... .......... 13% 208M 1s 2019-11-27T15:24:32.366 INFO:teuthology.orchestra.run.smithi156.stderr: 9850K .......... .......... .......... .......... .......... 13% 196M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 9900K .......... .......... .......... .......... .......... 13% 212M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 9950K .......... .......... .......... .......... .......... 13% 173M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 10000K .......... .......... .......... .......... .......... 13% 205M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 10050K .......... .......... .......... .......... .......... 13% 210M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 10100K .......... .......... .......... .......... .......... 13% 199M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 10150K .......... .......... .......... .......... .......... 13% 191M 1s 2019-11-27T15:24:32.367 INFO:teuthology.orchestra.run.smithi156.stderr: 10200K .......... .......... .......... .......... .......... 13% 202M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10250K .......... .......... .......... .......... .......... 14% 206M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10300K .......... .......... .......... .......... .......... 14% 213M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10350K .......... .......... .......... .......... .......... 14% 170M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10400K .......... .......... .......... .......... .......... 14% 206M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10450K .......... .......... .......... .......... .......... 14% 213M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10500K .......... .......... .......... .......... .......... 14% 215M 1s 2019-11-27T15:24:32.368 INFO:teuthology.orchestra.run.smithi156.stderr: 10550K .......... .......... .......... .......... .......... 14% 160M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10600K .......... .......... .......... .......... .......... 14% 236M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10650K .......... .......... .......... .......... .......... 14% 185M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10700K .......... .......... .......... .......... .......... 14% 221M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10750K .......... .......... .......... .......... .......... 14% 225M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10800K .......... .......... .......... .......... .......... 14% 301M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10850K .......... .......... .......... .......... .......... 14% 289M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10900K .......... .......... .......... .......... .......... 14% 296M 1s 2019-11-27T15:24:32.369 INFO:teuthology.orchestra.run.smithi156.stderr: 10950K .......... .......... .......... .......... .......... 14% 224M 1s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11000K .......... .......... .......... .......... .......... 15% 195M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11050K .......... .......... .......... .......... .......... 15% 241M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11100K .......... .......... .......... .......... .......... 15% 224M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11150K .......... .......... .......... .......... .......... 15% 196M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11200K .......... .......... .......... .......... .......... 15% 301M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11250K .......... .......... .......... .......... .......... 15% 300M 0s 2019-11-27T15:24:32.370 INFO:teuthology.orchestra.run.smithi156.stderr: 11300K .......... .......... .......... .......... .......... 15% 303M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11350K .......... .......... .......... .......... .......... 15% 271M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11400K .......... .......... .......... .......... .......... 15% 308M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11450K .......... .......... .......... .......... .......... 15% 252M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11500K .......... .......... .......... .......... .......... 15% 278M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11550K .......... .......... .......... .......... .......... 15% 240M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11600K .......... .......... .......... .......... .......... 15% 291M 0s 2019-11-27T15:24:32.371 INFO:teuthology.orchestra.run.smithi156.stderr: 11650K .......... .......... .......... .......... .......... 15% 278M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11700K .......... .......... .......... .......... .......... 15% 286M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11750K .......... .......... .......... .......... .......... 16% 262M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11800K .......... .......... .......... .......... .......... 16% 295M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11850K .......... .......... .......... .......... .......... 16% 311M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11900K .......... .......... .......... .......... .......... 16% 262M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 11950K .......... .......... .......... .......... .......... 16% 254M 0s 2019-11-27T15:24:32.372 INFO:teuthology.orchestra.run.smithi156.stderr: 12000K .......... .......... .......... .......... .......... 16% 272M 0s 2019-11-27T15:24:32.373 INFO:teuthology.orchestra.run.smithi156.stderr: 12050K .......... .......... .......... .......... .......... 16% 268M 0s 2019-11-27T15:24:32.373 INFO:teuthology.orchestra.run.smithi156.stderr: 12100K .......... .......... .......... .......... .......... 16% 291M 0s 2019-11-27T15:24:32.373 INFO:teuthology.orchestra.run.smithi156.stderr: 12150K .......... .......... .......... .......... .......... 16% 286M 0s 2019-11-27T15:24:32.373 INFO:teuthology.orchestra.run.smithi156.stderr: 12200K .......... .......... .......... .......... .......... 16% 315M 0s 2019-11-27T15:24:32.373 INFO:teuthology.orchestra.run.smithi156.stderr: 12250K .......... .......... .......... .......... .......... 16% 314M 0s 2019-11-27T15:24:32.376 INFO:teuthology.orchestra.run.smithi156.stderr: 12300K .......... .......... .......... .......... .......... 16% 314M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12350K .......... .......... .......... .......... .......... 16% 250M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12400K .......... .......... .......... .......... .......... 16% 322M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12450K .......... .......... .......... .......... .......... 16% 322M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12500K .......... .......... .......... .......... .......... 17% 316M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12550K .......... .......... .......... .......... .......... 17% 282M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12600K .......... .......... .......... .......... .......... 17% 313M 0s 2019-11-27T15:24:32.377 INFO:teuthology.orchestra.run.smithi156.stderr: 12650K .......... .......... .......... .......... .......... 17% 277M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12700K .......... .......... .......... .......... .......... 17% 300M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12750K .......... .......... .......... .......... .......... 17% 252M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12800K .......... .......... .......... .......... .......... 17% 306M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12850K .......... .......... .......... .......... .......... 17% 303M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12900K .......... .......... .......... .......... .......... 17% 323M 0s 2019-11-27T15:24:32.378 INFO:teuthology.orchestra.run.smithi156.stderr: 12950K .......... .......... .......... .......... .......... 17% 269M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13000K .......... .......... .......... .......... .......... 17% 328M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13050K .......... .......... .......... .......... .......... 17% 311M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13100K .......... .......... .......... .......... .......... 17% 310M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13150K .......... .......... .......... .......... .......... 17% 229M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13200K .......... .......... .......... .......... .......... 18% 293M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13250K .......... .......... .......... .......... .......... 18% 296M 0s 2019-11-27T15:24:32.379 INFO:teuthology.orchestra.run.smithi156.stderr: 13300K .......... .......... .......... .......... .......... 18% 292M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13350K .......... .......... .......... .......... .......... 18% 264M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13400K .......... .......... .......... .......... .......... 18% 304M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13450K .......... .......... .......... .......... .......... 18% 303M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13500K .......... .......... .......... .......... .......... 18% 281M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13550K .......... .......... .......... .......... .......... 18% 246M 0s 2019-11-27T15:24:32.380 INFO:teuthology.orchestra.run.smithi156.stderr: 13600K .......... .......... .......... .......... .......... 18% 272M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13650K .......... .......... .......... .......... .......... 18% 314M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13700K .......... .......... .......... .......... .......... 18% 304M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13750K .......... .......... .......... .......... .......... 18% 283M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13800K .......... .......... .......... .......... .......... 18% 304M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13850K .......... .......... .......... .......... .......... 18% 322M 0s 2019-11-27T15:24:32.381 INFO:teuthology.orchestra.run.smithi156.stderr: 13900K .......... .......... .......... .......... .......... 18% 307M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 13950K .......... .......... .......... .......... .......... 19% 272M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 14000K .......... .......... .......... .......... .......... 19% 321M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 14050K .......... .......... .......... .......... .......... 19% 325M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 14100K .......... .......... .......... .......... .......... 19% 214M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 14150K .......... .......... .......... .......... .......... 19% 244M 0s 2019-11-27T15:24:32.382 INFO:teuthology.orchestra.run.smithi156.stderr: 14200K .......... .......... .......... .......... .......... 19% 315M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14250K .......... .......... .......... .......... .......... 19% 297M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14300K .......... .......... .......... .......... .......... 19% 312M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14350K .......... .......... .......... .......... .......... 19% 268M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14400K .......... .......... .......... .......... .......... 19% 282M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14450K .......... .......... .......... .......... .......... 19% 285M 0s 2019-11-27T15:24:32.383 INFO:teuthology.orchestra.run.smithi156.stderr: 14500K .......... .......... .......... .......... .......... 19% 288M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14550K .......... .......... .......... .......... .......... 19% 250M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14600K .......... .......... .......... .......... .......... 19% 299M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14650K .......... .......... .......... .......... .......... 19% 313M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14700K .......... .......... .......... .......... .......... 20% 290M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14750K .......... .......... .......... .......... .......... 20% 243M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14800K .......... .......... .......... .......... .......... 20% 310M 0s 2019-11-27T15:24:32.384 INFO:teuthology.orchestra.run.smithi156.stderr: 14850K .......... .......... .......... .......... .......... 20% 267M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 14900K .......... .......... .......... .......... .......... 20% 273M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 14950K .......... .......... .......... .......... .......... 20% 206M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 15000K .......... .......... .......... .......... .......... 20% 266M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 15050K .......... .......... .......... .......... .......... 20% 273M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 15100K .......... .......... .......... .......... .......... 20% 276M 0s 2019-11-27T15:24:32.385 INFO:teuthology.orchestra.run.smithi156.stderr: 15150K .......... .......... .......... .......... .......... 20% 273M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15200K .......... .......... .......... .......... .......... 20% 288M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15250K .......... .......... .......... .......... .......... 20% 264M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15300K .......... .......... .......... .......... .......... 20% 236M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15350K .......... .......... .......... .......... .......... 20% 293M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15400K .......... .......... .......... .......... .......... 21% 279M 0s 2019-11-27T15:24:32.386 INFO:teuthology.orchestra.run.smithi156.stderr: 15450K .......... .......... .......... .......... .......... 21% 243M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15500K .......... .......... .......... .......... .......... 21% 255M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15550K .......... .......... .......... .......... .......... 21% 234M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15600K .......... .......... .......... .......... .......... 21% 285M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15650K .......... .......... .......... .......... .......... 21% 306M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15700K .......... .......... .......... .......... .......... 21% 325M 0s 2019-11-27T15:24:32.387 INFO:teuthology.orchestra.run.smithi156.stderr: 15750K .......... .......... .......... .......... .......... 21% 282M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 15800K .......... .......... .......... .......... .......... 21% 328M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 15850K .......... .......... .......... .......... .......... 21% 316M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 15900K .......... .......... .......... .......... .......... 21% 341M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 15950K .......... .......... .......... .......... .......... 21% 261M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 16000K .......... .......... .......... .......... .......... 21% 316M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 16050K .......... .......... .......... .......... .......... 21% 318M 0s 2019-11-27T15:24:32.388 INFO:teuthology.orchestra.run.smithi156.stderr: 16100K .......... .......... .......... .......... .......... 21% 321M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16150K .......... .......... .......... .......... .......... 22% 296M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16200K .......... .......... .......... .......... .......... 22% 331M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16250K .......... .......... .......... .......... .......... 22% 318M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16300K .......... .......... .......... .......... .......... 22% 302M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16350K .......... .......... .......... .......... .......... 22% 262M 0s 2019-11-27T15:24:32.389 INFO:teuthology.orchestra.run.smithi156.stderr: 16400K .......... .......... .......... .......... .......... 22% 298M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16450K .......... .......... .......... .......... .......... 22% 301M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16500K .......... .......... .......... .......... .......... 22% 326M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16550K .......... .......... .......... .......... .......... 22% 280M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16600K .......... .......... .......... .......... .......... 22% 279M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16650K .......... .......... .......... .......... .......... 22% 280M 0s 2019-11-27T15:24:32.390 INFO:teuthology.orchestra.run.smithi156.stderr: 16700K .......... .......... .......... .......... .......... 22% 251M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 16750K .......... .......... .......... .......... .......... 22% 253M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 16800K .......... .......... .......... .......... .......... 22% 326M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 16850K .......... .......... .......... .......... .......... 22% 322M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 16900K .......... .......... .......... .......... .......... 23% 320M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 16950K .......... .......... .......... .......... .......... 23% 300M 0s 2019-11-27T15:24:32.391 INFO:teuthology.orchestra.run.smithi156.stderr: 17000K .......... .......... .......... .......... .......... 23% 321M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17050K .......... .......... .......... .......... .......... 23% 323M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17100K .......... .......... .......... .......... .......... 23% 321M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17150K .......... .......... .......... .......... .......... 23% 267M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17200K .......... .......... .......... .......... .......... 23% 310M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17250K .......... .......... .......... .......... .......... 23% 332M 0s 2019-11-27T15:24:32.392 INFO:teuthology.orchestra.run.smithi156.stderr: 17300K .......... .......... .......... .......... .......... 23% 323M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17350K .......... .......... .......... .......... .......... 23% 230M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17400K .......... .......... .......... .......... .......... 23% 335M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17450K .......... .......... .......... .......... .......... 23% 254M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17500K .......... .......... .......... .......... .......... 23% 292M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17550K .......... .......... .......... .......... .......... 23% 277M 0s 2019-11-27T15:24:32.393 INFO:teuthology.orchestra.run.smithi156.stderr: 17600K .......... .......... .......... .......... .......... 23% 324M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17650K .......... .......... .......... .......... .......... 24% 288M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17700K .......... .......... .......... .......... .......... 24% 303M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17750K .......... .......... .......... .......... .......... 24% 280M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17800K .......... .......... .......... .......... .......... 24% 318M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17850K .......... .......... .......... .......... .......... 24% 315M 0s 2019-11-27T15:24:32.394 INFO:teuthology.orchestra.run.smithi156.stderr: 17900K .......... .......... .......... .......... .......... 24% 315M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 17950K .......... .......... .......... .......... .......... 24% 245M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18000K .......... .......... .......... .......... .......... 24% 305M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18050K .......... .......... .......... .......... .......... 24% 316M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18100K .......... .......... .......... .......... .......... 24% 292M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18150K .......... .......... .......... .......... .......... 24% 288M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18200K .......... .......... .......... .......... .......... 24% 304M 0s 2019-11-27T15:24:32.395 INFO:teuthology.orchestra.run.smithi156.stderr: 18250K .......... .......... .......... .......... .......... 24% 294M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18300K .......... .......... .......... .......... .......... 24% 294M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18350K .......... .......... .......... .......... .......... 25% 273M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18400K .......... .......... .......... .......... .......... 25% 324M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18450K .......... .......... .......... .......... .......... 25% 327M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18500K .......... .......... .......... .......... .......... 25% 325M 0s 2019-11-27T15:24:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: 18550K .......... .......... .......... .......... .......... 25% 277M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18600K .......... .......... .......... .......... .......... 25% 326M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18650K .......... .......... .......... .......... .......... 25% 328M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18700K .......... .......... .......... .......... .......... 25% 344M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18750K .......... .......... .......... .......... .......... 25% 273M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18800K .......... .......... .......... .......... .......... 25% 219M 0s 2019-11-27T15:24:32.397 INFO:teuthology.orchestra.run.smithi156.stderr: 18850K .......... .......... .......... .......... .......... 25% 206M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 18900K .......... .......... .......... .......... .......... 25% 199M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 18950K .......... .......... .......... .......... .......... 25% 177M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 19000K .......... .......... .......... .......... .......... 25% 226M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 19050K .......... .......... .......... .......... .......... 25% 222M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 19100K .......... .......... .......... .......... .......... 26% 185M 0s 2019-11-27T15:24:32.398 INFO:teuthology.orchestra.run.smithi156.stderr: 19150K .......... .......... .......... .......... .......... 26% 120M 0s 2019-11-27T15:24:32.399 INFO:teuthology.orchestra.run.smithi156.stderr: 19200K .......... .......... .......... .......... .......... 26% 265M 0s 2019-11-27T15:24:32.399 INFO:teuthology.orchestra.run.smithi156.stderr: 19250K .......... .......... .......... .......... .......... 26% 264M 0s 2019-11-27T15:24:32.399 INFO:teuthology.orchestra.run.smithi156.stderr: 19300K .......... .......... .......... .......... .......... 26% 262M 0s 2019-11-27T15:24:32.399 INFO:teuthology.orchestra.run.smithi156.stderr: 19350K .......... .......... .......... .......... .......... 26% 173M 0s 2019-11-27T15:24:32.399 INFO:teuthology.orchestra.run.smithi156.stderr: 19400K .......... .......... .......... .......... .......... 26% 224M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19450K .......... .......... .......... .......... .......... 26% 217M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19500K .......... .......... .......... .......... .......... 26% 220M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19550K .......... .......... .......... .......... .......... 26% 182M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19600K .......... .......... .......... .......... .......... 26% 233M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19650K .......... .......... .......... .......... .......... 26% 223M 0s 2019-11-27T15:24:32.400 INFO:teuthology.orchestra.run.smithi156.stderr: 19700K .......... .......... .......... .......... .......... 26% 212M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 19750K .......... .......... .......... .......... .......... 26% 221M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 19800K .......... .......... .......... .......... .......... 26% 224M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 19850K .......... .......... .......... .......... .......... 27% 230M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 19900K .......... .......... .......... .......... .......... 27% 222M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 19950K .......... .......... .......... .......... .......... 27% 190M 0s 2019-11-27T15:24:32.401 INFO:teuthology.orchestra.run.smithi156.stderr: 20000K .......... .......... .......... .......... .......... 27% 231M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20050K .......... .......... .......... .......... .......... 27% 246M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20100K .......... .......... .......... .......... .......... 27% 237M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20150K .......... .......... .......... .......... .......... 27% 211M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20200K .......... .......... .......... .......... .......... 27% 226M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20250K .......... .......... .......... .......... .......... 27% 234M 0s 2019-11-27T15:24:32.402 INFO:teuthology.orchestra.run.smithi156.stderr: 20300K .......... .......... .......... .......... .......... 27% 229M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20350K .......... .......... .......... .......... .......... 27% 199M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20400K .......... .......... .......... .......... .......... 27% 224M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20450K .......... .......... .......... .......... .......... 27% 245M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20500K .......... .......... .......... .......... .......... 27% 237M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20550K .......... .......... .......... .......... .......... 28% 210M 0s 2019-11-27T15:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr: 20600K .......... .......... .......... .......... .......... 28% 231M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20650K .......... .......... .......... .......... .......... 28% 245M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20700K .......... .......... .......... .......... .......... 28% 252M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20750K .......... .......... .......... .......... .......... 28% 209M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20800K .......... .......... .......... .......... .......... 28% 160M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20850K .......... .......... .......... .......... .......... 28% 244M 0s 2019-11-27T15:24:32.404 INFO:teuthology.orchestra.run.smithi156.stderr: 20900K .......... .......... .......... .......... .......... 28% 242M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 20950K .......... .......... .......... .......... .......... 28% 221M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 21000K .......... .......... .......... .......... .......... 28% 237M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 21050K .......... .......... .......... .......... .......... 28% 236M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 21100K .......... .......... .......... .......... .......... 28% 245M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 21150K .......... .......... .......... .......... .......... 28% 236M 0s 2019-11-27T15:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr: 21200K .......... .......... .......... .......... .......... 28% 285M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21250K .......... .......... .......... .......... .......... 28% 287M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21300K .......... .......... .......... .......... .......... 29% 258M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21350K .......... .......... .......... .......... .......... 29% 256M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21400K .......... .......... .......... .......... .......... 29% 280M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21450K .......... .......... .......... .......... .......... 29% 278M 0s 2019-11-27T15:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr: 21500K .......... .......... .......... .......... .......... 29% 285M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21550K .......... .......... .......... .......... .......... 29% 230M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21600K .......... .......... .......... .......... .......... 29% 259M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21650K .......... .......... .......... .......... .......... 29% 263M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21700K .......... .......... .......... .......... .......... 29% 256M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21750K .......... .......... .......... .......... .......... 29% 266M 0s 2019-11-27T15:24:32.407 INFO:teuthology.orchestra.run.smithi156.stderr: 21800K .......... .......... .......... .......... .......... 29% 274M 0s 2019-11-27T15:24:32.408 INFO:teuthology.orchestra.run.smithi156.stderr: 21850K .......... .......... .......... .......... .......... 29% 255M 0s 2019-11-27T15:24:32.408 INFO:teuthology.orchestra.run.smithi156.stderr: 21900K .......... .......... .......... .......... .......... 29% 289M 0s 2019-11-27T15:24:32.408 INFO:teuthology.orchestra.run.smithi156.stderr: 21950K .......... .......... .......... .......... .......... 29% 228M 0s 2019-11-27T15:24:32.408 INFO:teuthology.orchestra.run.smithi156.stderr: 22000K .......... .......... .......... .......... .......... 29% 278M 0s 2019-11-27T15:24:32.408 INFO:teuthology.orchestra.run.smithi156.stderr: 22050K .......... .......... .......... .......... .......... 30% 294M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22100K .......... .......... .......... .......... .......... 30% 272M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22150K .......... .......... .......... .......... .......... 30% 263M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22200K .......... .......... .......... .......... .......... 30% 281M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22250K .......... .......... .......... .......... .......... 30% 296M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22300K .......... .......... .......... .......... .......... 30% 295M 0s 2019-11-27T15:24:32.409 INFO:teuthology.orchestra.run.smithi156.stderr: 22350K .......... .......... .......... .......... .......... 30% 245M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22400K .......... .......... .......... .......... .......... 30% 286M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22450K .......... .......... .......... .......... .......... 30% 297M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22500K .......... .......... .......... .......... .......... 30% 290M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22550K .......... .......... .......... .......... .......... 30% 269M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22600K .......... .......... .......... .......... .......... 30% 304M 0s 2019-11-27T15:24:32.410 INFO:teuthology.orchestra.run.smithi156.stderr: 22650K .......... .......... .......... .......... .......... 30% 292M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22700K .......... .......... .......... .......... .......... 30% 281M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22750K .......... .......... .......... .......... .......... 30% 226M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22800K .......... .......... .......... .......... .......... 31% 258M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22850K .......... .......... .......... .......... .......... 31% 271M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22900K .......... .......... .......... .......... .......... 31% 267M 0s 2019-11-27T15:24:32.411 INFO:teuthology.orchestra.run.smithi156.stderr: 22950K .......... .......... .......... .......... .......... 31% 239M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23000K .......... .......... .......... .......... .......... 31% 254M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23050K .......... .......... .......... .......... .......... 31% 274M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23100K .......... .......... .......... .......... .......... 31% 261M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23150K .......... .......... .......... .......... .......... 31% 165M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23200K .......... .......... .......... .......... .......... 31% 216M 0s 2019-11-27T15:24:32.412 INFO:teuthology.orchestra.run.smithi156.stderr: 23250K .......... .......... .......... .......... .......... 31% 266M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23300K .......... .......... .......... .......... .......... 31% 283M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23350K .......... .......... .......... .......... .......... 31% 252M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23400K .......... .......... .......... .......... .......... 31% 279M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23450K .......... .......... .......... .......... .......... 31% 289M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23500K .......... .......... .......... .......... .......... 32% 284M 0s 2019-11-27T15:24:32.413 INFO:teuthology.orchestra.run.smithi156.stderr: 23550K .......... .......... .......... .......... .......... 32% 246M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23600K .......... .......... .......... .......... .......... 32% 293M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23650K .......... .......... .......... .......... .......... 32% 280M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23700K .......... .......... .......... .......... .......... 32% 275M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23750K .......... .......... .......... .......... .......... 32% 253M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23800K .......... .......... .......... .......... .......... 32% 297M 0s 2019-11-27T15:24:32.414 INFO:teuthology.orchestra.run.smithi156.stderr: 23850K .......... .......... .......... .......... .......... 32% 278M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 23900K .......... .......... .......... .......... .......... 32% 285M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 23950K .......... .......... .......... .......... .......... 32% 239M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 24000K .......... .......... .......... .......... .......... 32% 291M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 24050K .......... .......... .......... .......... .......... 32% 279M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 24100K .......... .......... .......... .......... .......... 32% 285M 0s 2019-11-27T15:24:32.415 INFO:teuthology.orchestra.run.smithi156.stderr: 24150K .......... .......... .......... .......... .......... 32% 256M 0s 2019-11-27T15:24:32.416 INFO:teuthology.orchestra.run.smithi156.stderr: 24200K .......... .......... .......... .......... .......... 32% 277M 0s 2019-11-27T15:24:32.416 INFO:teuthology.orchestra.run.smithi156.stderr: 24250K .......... .......... .......... .......... .......... 33% 265M 0s 2019-11-27T15:24:32.416 INFO:teuthology.orchestra.run.smithi156.stderr: 24300K .......... .......... .......... .......... .......... 33% 274M 0s 2019-11-27T15:24:32.416 INFO:teuthology.orchestra.run.smithi156.stderr: 24350K .......... .......... .......... .......... .......... 33% 224M 0s 2019-11-27T15:24:32.416 INFO:teuthology.orchestra.run.smithi156.stderr: 24400K .......... .......... .......... .......... .......... 33% 298M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24450K .......... .......... .......... .......... .......... 33% 303M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24500K .......... .......... .......... .......... .......... 33% 291M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24550K .......... .......... .......... .......... .......... 33% 264M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24600K .......... .......... .......... .......... .......... 33% 297M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24650K .......... .......... .......... .......... .......... 33% 287M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24700K .......... .......... .......... .......... .......... 33% 296M 0s 2019-11-27T15:24:32.417 INFO:teuthology.orchestra.run.smithi156.stderr: 24750K .......... .......... .......... .......... .......... 33% 237M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 24800K .......... .......... .......... .......... .......... 33% 291M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 24850K .......... .......... .......... .......... .......... 33% 268M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 24900K .......... .......... .......... .......... .......... 33% 298M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 24950K .......... .......... .......... .......... .......... 33% 257M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 25000K .......... .......... .......... .......... .......... 34% 278M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 25050K .......... .......... .......... .......... .......... 34% 301M 0s 2019-11-27T15:24:32.418 INFO:teuthology.orchestra.run.smithi156.stderr: 25100K .......... .......... .......... .......... .......... 34% 280M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25150K .......... .......... .......... .......... .......... 34% 216M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25200K .......... .......... .......... .......... .......... 34% 286M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25250K .......... .......... .......... .......... .......... 34% 222M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25300K .......... .......... .......... .......... .......... 34% 274M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25350K .......... .......... .......... .......... .......... 34% 254M 0s 2019-11-27T15:24:32.419 INFO:teuthology.orchestra.run.smithi156.stderr: 25400K .......... .......... .......... .......... .......... 34% 272M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25450K .......... .......... .......... .......... .......... 34% 263M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25500K .......... .......... .......... .......... .......... 34% 267M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25550K .......... .......... .......... .......... .......... 34% 236M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25600K .......... .......... .......... .......... .......... 34% 269M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25650K .......... .......... .......... .......... .......... 34% 284M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25700K .......... .......... .......... .......... .......... 35% 286M 0s 2019-11-27T15:24:32.420 INFO:teuthology.orchestra.run.smithi156.stderr: 25750K .......... .......... .......... .......... .......... 35% 256M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 25800K .......... .......... .......... .......... .......... 35% 297M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 25850K .......... .......... .......... .......... .......... 35% 287M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 25900K .......... .......... .......... .......... .......... 35% 291M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 25950K .......... .......... .......... .......... .......... 35% 232M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 26000K .......... .......... .......... .......... .......... 35% 281M 0s 2019-11-27T15:24:32.421 INFO:teuthology.orchestra.run.smithi156.stderr: 26050K .......... .......... .......... .......... .......... 35% 282M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26100K .......... .......... .......... .......... .......... 35% 244M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26150K .......... .......... .......... .......... .......... 35% 201M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26200K .......... .......... .......... .......... .......... 35% 226M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26250K .......... .......... .......... .......... .......... 35% 256M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26300K .......... .......... .......... .......... .......... 35% 270M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26350K .......... .......... .......... .......... .......... 35% 220M 0s 2019-11-27T15:24:32.422 INFO:teuthology.orchestra.run.smithi156.stderr: 26400K .......... .......... .......... .......... .......... 35% 269M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26450K .......... .......... .......... .......... .......... 36% 262M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26500K .......... .......... .......... .......... .......... 36% 279M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26550K .......... .......... .......... .......... .......... 36% 258M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26600K .......... .......... .......... .......... .......... 36% 279M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26650K .......... .......... .......... .......... .......... 36% 299M 0s 2019-11-27T15:24:32.423 INFO:teuthology.orchestra.run.smithi156.stderr: 26700K .......... .......... .......... .......... .......... 36% 282M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 26750K .......... .......... .......... .......... .......... 36% 239M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 26800K .......... .......... .......... .......... .......... 36% 278M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 26850K .......... .......... .......... .......... .......... 36% 288M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 26900K .......... .......... .......... .......... .......... 36% 274M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 26950K .......... .......... .......... .......... .......... 36% 262M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 27000K .......... .......... .......... .......... .......... 36% 271M 0s 2019-11-27T15:24:32.424 INFO:teuthology.orchestra.run.smithi156.stderr: 27050K .......... .......... .......... .......... .......... 36% 276M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27100K .......... .......... .......... .......... .......... 36% 281M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27150K .......... .......... .......... .......... .......... 36% 231M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27200K .......... .......... .......... .......... .......... 37% 289M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27250K .......... .......... .......... .......... .......... 37% 288M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27300K .......... .......... .......... .......... .......... 37% 275M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27350K .......... .......... .......... .......... .......... 37% 259M 0s 2019-11-27T15:24:32.425 INFO:teuthology.orchestra.run.smithi156.stderr: 27400K .......... .......... .......... .......... .......... 37% 281M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27450K .......... .......... .......... .......... .......... 37% 268M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27500K .......... .......... .......... .......... .......... 37% 277M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27550K .......... .......... .......... .......... .......... 37% 223M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27600K .......... .......... .......... .......... .......... 37% 224M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27650K .......... .......... .......... .......... .......... 37% 278M 0s 2019-11-27T15:24:32.426 INFO:teuthology.orchestra.run.smithi156.stderr: 27700K .......... .......... .......... .......... .......... 37% 290M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 27750K .......... .......... .......... .......... .......... 37% 256M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 27800K .......... .......... .......... .......... .......... 37% 270M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 27850K .......... .......... .......... .......... .......... 37% 286M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 27900K .......... .......... .......... .......... .......... 37% 290M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 27950K .......... .......... .......... .......... .......... 38% 227M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 28000K .......... .......... .......... .......... .......... 38% 276M 0s 2019-11-27T15:24:32.427 INFO:teuthology.orchestra.run.smithi156.stderr: 28050K .......... .......... .......... .......... .......... 38% 288M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28100K .......... .......... .......... .......... .......... 38% 261M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28150K .......... .......... .......... .......... .......... 38% 249M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28200K .......... .......... .......... .......... .......... 38% 241M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28250K .......... .......... .......... .......... .......... 38% 240M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28300K .......... .......... .......... .......... .......... 38% 248M 0s 2019-11-27T15:24:32.428 INFO:teuthology.orchestra.run.smithi156.stderr: 28350K .......... .......... .......... .......... .......... 38% 211M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28400K .......... .......... .......... .......... .......... 38% 269M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28450K .......... .......... .......... .......... .......... 38% 260M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28500K .......... .......... .......... .......... .......... 38% 261M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28550K .......... .......... .......... .......... .......... 38% 255M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28600K .......... .......... .......... .......... .......... 38% 280M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28650K .......... .......... .......... .......... .......... 39% 280M 0s 2019-11-27T15:24:32.429 INFO:teuthology.orchestra.run.smithi156.stderr: 28700K .......... .......... .......... .......... .......... 39% 288M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 28750K .......... .......... .......... .......... .......... 39% 246M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 28800K .......... .......... .......... .......... .......... 39% 295M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 28850K .......... .......... .......... .......... .......... 39% 294M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 28900K .......... .......... .......... .......... .......... 39% 276M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 28950K .......... .......... .......... .......... .......... 39% 257M 0s 2019-11-27T15:24:32.430 INFO:teuthology.orchestra.run.smithi156.stderr: 29000K .......... .......... .......... .......... .......... 39% 284M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29050K .......... .......... .......... .......... .......... 39% 253M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29100K .......... .......... .......... .......... .......... 39% 246M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29150K .......... .......... .......... .......... .......... 39% 233M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29200K .......... .......... .......... .......... .......... 39% 276M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29250K .......... .......... .......... .......... .......... 39% 279M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29300K .......... .......... .......... .......... .......... 39% 276M 0s 2019-11-27T15:24:32.431 INFO:teuthology.orchestra.run.smithi156.stderr: 29350K .......... .......... .......... .......... .......... 39% 246M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29400K .......... .......... .......... .......... .......... 40% 276M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29450K .......... .......... .......... .......... .......... 40% 267M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29500K .......... .......... .......... .......... .......... 40% 278M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29550K .......... .......... .......... .......... .......... 40% 233M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29600K .......... .......... .......... .......... .......... 40% 277M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29650K .......... .......... .......... .......... .......... 40% 293M 0s 2019-11-27T15:24:32.432 INFO:teuthology.orchestra.run.smithi156.stderr: 29700K .......... .......... .......... .......... .......... 40% 277M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 29750K .......... .......... .......... .......... .......... 40% 237M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 29800K .......... .......... .......... .......... .......... 40% 258M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 29850K .......... .......... .......... .......... .......... 40% 275M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 29900K .......... .......... .......... .......... .......... 40% 267M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 29950K .......... .......... .......... .......... .......... 40% 216M 0s 2019-11-27T15:24:32.433 INFO:teuthology.orchestra.run.smithi156.stderr: 30000K .......... .......... .......... .......... .......... 40% 273M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30050K .......... .......... .......... .......... .......... 40% 266M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30100K .......... .......... .......... .......... .......... 40% 291M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30150K .......... .......... .......... .......... .......... 41% 247M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30200K .......... .......... .......... .......... .......... 41% 287M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30250K .......... .......... .......... .......... .......... 41% 226M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30300K .......... .......... .......... .......... .......... 41% 274M 0s 2019-11-27T15:24:32.434 INFO:teuthology.orchestra.run.smithi156.stderr: 30350K .......... .......... .......... .......... .......... 41% 230M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30400K .......... .......... .......... .......... .......... 41% 267M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30450K .......... .......... .......... .......... .......... 41% 263M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30500K .......... .......... .......... .......... .......... 41% 228M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30550K .......... .......... .......... .......... .......... 41% 269M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30600K .......... .......... .......... .......... .......... 41% 291M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30650K .......... .......... .......... .......... .......... 41% 303M 0s 2019-11-27T15:24:32.435 INFO:teuthology.orchestra.run.smithi156.stderr: 30700K .......... .......... .......... .......... .......... 41% 302M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 30750K .......... .......... .......... .......... .......... 41% 253M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 30800K .......... .......... .......... .......... .......... 41% 310M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 30850K .......... .......... .......... .......... .......... 42% 302M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 30900K .......... .......... .......... .......... .......... 42% 291M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 30950K .......... .......... .......... .......... .......... 42% 268M 0s 2019-11-27T15:24:32.436 INFO:teuthology.orchestra.run.smithi156.stderr: 31000K .......... .......... .......... .......... .......... 42% 282M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31050K .......... .......... .......... .......... .......... 42% 282M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31100K .......... .......... .......... .......... .......... 42% 284M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31150K .......... .......... .......... .......... .......... 42% 235M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31200K .......... .......... .......... .......... .......... 42% 284M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31250K .......... .......... .......... .......... .......... 42% 270M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31300K .......... .......... .......... .......... .......... 42% 288M 0s 2019-11-27T15:24:32.437 INFO:teuthology.orchestra.run.smithi156.stderr: 31350K .......... .......... .......... .......... .......... 42% 247M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31400K .......... .......... .......... .......... .......... 42% 281M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31450K .......... .......... .......... .......... .......... 42% 294M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31500K .......... .......... .......... .......... .......... 42% 304M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31550K .......... .......... .......... .......... .......... 42% 220M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31600K .......... .......... .......... .......... .......... 43% 280M 0s 2019-11-27T15:24:32.438 INFO:teuthology.orchestra.run.smithi156.stderr: 31650K .......... .......... .......... .......... .......... 43% 291M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31700K .......... .......... .......... .......... .......... 43% 291M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31750K .......... .......... .......... .......... .......... 43% 260M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31800K .......... .......... .......... .......... .......... 43% 288M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31850K .......... .......... .......... .......... .......... 43% 290M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31900K .......... .......... .......... .......... .......... 43% 292M 0s 2019-11-27T15:24:32.439 INFO:teuthology.orchestra.run.smithi156.stderr: 31950K .......... .......... .......... .......... .......... 43% 237M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32000K .......... .......... .......... .......... .......... 43% 285M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32050K .......... .......... .......... .......... .......... 43% 273M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32100K .......... .......... .......... .......... .......... 43% 254M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32150K .......... .......... .......... .......... .......... 43% 276M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32200K .......... .......... .......... .......... .......... 43% 237M 0s 2019-11-27T15:24:32.440 INFO:teuthology.orchestra.run.smithi156.stderr: 32250K .......... .......... .......... .......... .......... 43% 258M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32300K .......... .......... .......... .......... .......... 43% 284M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32350K .......... .......... .......... .......... .......... 44% 230M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32400K .......... .......... .......... .......... .......... 44% 312M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32450K .......... .......... .......... .......... .......... 44% 297M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32500K .......... .......... .......... .......... .......... 44% 254M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32550K .......... .......... .......... .......... .......... 44% 218M 0s 2019-11-27T15:24:32.441 INFO:teuthology.orchestra.run.smithi156.stderr: 32600K .......... .......... .......... .......... .......... 44% 275M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32650K .......... .......... .......... .......... .......... 44% 286M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32700K .......... .......... .......... .......... .......... 44% 269M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32750K .......... .......... .......... .......... .......... 44% 236M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32800K .......... .......... .......... .......... .......... 44% 299M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32850K .......... .......... .......... .......... .......... 44% 277M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32900K .......... .......... .......... .......... .......... 44% 293M 0s 2019-11-27T15:24:32.442 INFO:teuthology.orchestra.run.smithi156.stderr: 32950K .......... .......... .......... .......... .......... 44% 252M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33000K .......... .......... .......... .......... .......... 44% 291M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33050K .......... .......... .......... .......... .......... 44% 281M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33100K .......... .......... .......... .......... .......... 45% 281M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33150K .......... .......... .......... .......... .......... 45% 244M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33200K .......... .......... .......... .......... .......... 45% 285M 0s 2019-11-27T15:24:32.443 INFO:teuthology.orchestra.run.smithi156.stderr: 33250K .......... .......... .......... .......... .......... 45% 281M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33300K .......... .......... .......... .......... .......... 45% 287M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33350K .......... .......... .......... .......... .......... 45% 255M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33400K .......... .......... .......... .......... .......... 45% 295M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33450K .......... .......... .......... .......... .......... 45% 304M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33500K .......... .......... .......... .......... .......... 45% 301M 0s 2019-11-27T15:24:32.444 INFO:teuthology.orchestra.run.smithi156.stderr: 33550K .......... .......... .......... .......... .......... 45% 243M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33600K .......... .......... .......... .......... .......... 45% 298M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33650K .......... .......... .......... .......... .......... 45% 295M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33700K .......... .......... .......... .......... .......... 45% 299M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33750K .......... .......... .......... .......... .......... 45% 270M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33800K .......... .......... .......... .......... .......... 46% 300M 0s 2019-11-27T15:24:32.445 INFO:teuthology.orchestra.run.smithi156.stderr: 33850K .......... .......... .......... .......... .......... 46% 303M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 33900K .......... .......... .......... .......... .......... 46% 287M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 33950K .......... .......... .......... .......... .......... 46% 253M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 34000K .......... .......... .......... .......... .......... 46% 302M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 34050K .......... .......... .......... .......... .......... 46% 295M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 34100K .......... .......... .......... .......... .......... 46% 304M 0s 2019-11-27T15:24:32.446 INFO:teuthology.orchestra.run.smithi156.stderr: 34150K .......... .......... .......... .......... .......... 46% 259M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34200K .......... .......... .......... .......... .......... 46% 291M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34250K .......... .......... .......... .......... .......... 46% 304M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34300K .......... .......... .......... .......... .......... 46% 301M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34350K .......... .......... .......... .......... .......... 46% 246M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34400K .......... .......... .......... .......... .......... 46% 290M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34450K .......... .......... .......... .......... .......... 46% 234M 0s 2019-11-27T15:24:32.447 INFO:teuthology.orchestra.run.smithi156.stderr: 34500K .......... .......... .......... .......... .......... 46% 268M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34550K .......... .......... .......... .......... .......... 47% 273M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34600K .......... .......... .......... .......... .......... 47% 287M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34650K .......... .......... .......... .......... .......... 47% 283M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34700K .......... .......... .......... .......... .......... 47% 298M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34750K .......... .......... .......... .......... .......... 47% 247M 0s 2019-11-27T15:24:32.448 INFO:teuthology.orchestra.run.smithi156.stderr: 34800K .......... .......... .......... .......... .......... 47% 276M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 34850K .......... .......... .......... .......... .......... 47% 275M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 34900K .......... .......... .......... .......... .......... 47% 282M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 34950K .......... .......... .......... .......... .......... 47% 262M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 35000K .......... .......... .......... .......... .......... 47% 288M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 35050K .......... .......... .......... .......... .......... 47% 294M 0s 2019-11-27T15:24:32.449 INFO:teuthology.orchestra.run.smithi156.stderr: 35100K .......... .......... .......... .......... .......... 47% 292M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35150K .......... .......... .......... .......... .......... 47% 235M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35200K .......... .......... .......... .......... .......... 47% 283M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35250K .......... .......... .......... .......... .......... 47% 289M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35300K .......... .......... .......... .......... .......... 48% 285M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35350K .......... .......... .......... .......... .......... 48% 268M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35400K .......... .......... .......... .......... .......... 48% 296M 0s 2019-11-27T15:24:32.450 INFO:teuthology.orchestra.run.smithi156.stderr: 35450K .......... .......... .......... .......... .......... 48% 302M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35500K .......... .......... .......... .......... .......... 48% 282M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35550K .......... .......... .......... .......... .......... 48% 254M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35600K .......... .......... .......... .......... .......... 48% 294M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35650K .......... .......... .......... .......... .......... 48% 291M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35700K .......... .......... .......... .......... .......... 48% 302M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35750K .......... .......... .......... .......... .......... 48% 219M 0s 2019-11-27T15:24:32.451 INFO:teuthology.orchestra.run.smithi156.stderr: 35800K .......... .......... .......... .......... .......... 48% 291M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 35850K .......... .......... .......... .......... .......... 48% 246M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 35900K .......... .......... .......... .......... .......... 48% 228M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 35950K .......... .......... .......... .......... .......... 48% 228M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 36000K .......... .......... .......... .......... .......... 49% 269M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 36050K .......... .......... .......... .......... .......... 49% 286M 0s 2019-11-27T15:24:32.452 INFO:teuthology.orchestra.run.smithi156.stderr: 36100K .......... .......... .......... .......... .......... 49% 283M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36150K .......... .......... .......... .......... .......... 49% 270M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36200K .......... .......... .......... .......... .......... 49% 298M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36250K .......... .......... .......... .......... .......... 49% 278M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36300K .......... .......... .......... .......... .......... 49% 280M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36350K .......... .......... .......... .......... .......... 49% 242M 0s 2019-11-27T15:24:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: 36400K .......... .......... .......... .......... .......... 49% 259M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36450K .......... .......... .......... .......... .......... 49% 275M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36500K .......... .......... .......... .......... .......... 49% 269M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36550K .......... .......... .......... .......... .......... 49% 237M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36600K .......... .......... .......... .......... .......... 49% 284M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36650K .......... .......... .......... .......... .......... 49% 276M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36700K .......... .......... .......... .......... .......... 49% 215M 0s 2019-11-27T15:24:32.454 INFO:teuthology.orchestra.run.smithi156.stderr: 36750K .......... .......... .......... .......... .......... 50% 239M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 36800K .......... .......... .......... .......... .......... 50% 269M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 36850K .......... .......... .......... .......... .......... 50% 277M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 36900K .......... .......... .......... .......... .......... 50% 272M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 36950K .......... .......... .......... .......... .......... 50% 242M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 37000K .......... .......... .......... .......... .......... 50% 283M 0s 2019-11-27T15:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr: 37050K .......... .......... .......... .......... .......... 50% 299M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37100K .......... .......... .......... .......... .......... 50% 284M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37150K .......... .......... .......... .......... .......... 50% 240M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37200K .......... .......... .......... .......... .......... 50% 275M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37250K .......... .......... .......... .......... .......... 50% 295M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37300K .......... .......... .......... .......... .......... 50% 295M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37350K .......... .......... .......... .......... .......... 50% 251M 0s 2019-11-27T15:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr: 37400K .......... .......... .......... .......... .......... 50% 282M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37450K .......... .......... .......... .......... .......... 50% 282M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37500K .......... .......... .......... .......... .......... 51% 246M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37550K .......... .......... .......... .......... .......... 51% 220M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37600K .......... .......... .......... .......... .......... 51% 256M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37650K .......... .......... .......... .......... .......... 51% 240M 0s 2019-11-27T15:24:32.457 INFO:teuthology.orchestra.run.smithi156.stderr: 37700K .......... .......... .......... .......... .......... 51% 289M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 37750K .......... .......... .......... .......... .......... 51% 245M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 37800K .......... .......... .......... .......... .......... 51% 269M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 37850K .......... .......... .......... .......... .......... 51% 275M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 37900K .......... .......... .......... .......... .......... 51% 281M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 37950K .......... .......... .......... .......... .......... 51% 228M 0s 2019-11-27T15:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr: 38000K .......... .......... .......... .......... .......... 51% 276M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38050K .......... .......... .......... .......... .......... 51% 283M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38100K .......... .......... .......... .......... .......... 51% 263M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38150K .......... .......... .......... .......... .......... 51% 246M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38200K .......... .......... .......... .......... .......... 51% 271M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38250K .......... .......... .......... .......... .......... 52% 272M 0s 2019-11-27T15:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr: 38300K .......... .......... .......... .......... .......... 52% 272M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38350K .......... .......... .......... .......... .......... 52% 237M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38400K .......... .......... .......... .......... .......... 52% 261M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38450K .......... .......... .......... .......... .......... 52% 275M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38500K .......... .......... .......... .......... .......... 52% 290M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38550K .......... .......... .......... .......... .......... 52% 233M 0s 2019-11-27T15:24:32.460 INFO:teuthology.orchestra.run.smithi156.stderr: 38600K .......... .......... .......... .......... .......... 52% 286M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38650K .......... .......... .......... .......... .......... 52% 313M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38700K .......... .......... .......... .......... .......... 52% 247M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38750K .......... .......... .......... .......... .......... 52% 211M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38800K .......... .......... .......... .......... .......... 52% 274M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38850K .......... .......... .......... .......... .......... 52% 288M 0s 2019-11-27T15:24:32.461 INFO:teuthology.orchestra.run.smithi156.stderr: 38900K .......... .......... .......... .......... .......... 52% 294M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 38950K .......... .......... .......... .......... .......... 53% 271M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 39000K .......... .......... .......... .......... .......... 53% 292M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 39050K .......... .......... .......... .......... .......... 53% 314M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 39100K .......... .......... .......... .......... .......... 53% 298M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 39150K .......... .......... .......... .......... .......... 53% 252M 0s 2019-11-27T15:24:32.462 INFO:teuthology.orchestra.run.smithi156.stderr: 39200K .......... .......... .......... .......... .......... 53% 292M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39250K .......... .......... .......... .......... .......... 53% 294M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39300K .......... .......... .......... .......... .......... 53% 299M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39350K .......... .......... .......... .......... .......... 53% 276M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39400K .......... .......... .......... .......... .......... 53% 299M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39450K .......... .......... .......... .......... .......... 53% 294M 0s 2019-11-27T15:24:32.463 INFO:teuthology.orchestra.run.smithi156.stderr: 39500K .......... .......... .......... .......... .......... 53% 280M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39550K .......... .......... .......... .......... .......... 53% 250M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39600K .......... .......... .......... .......... .......... 53% 287M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39650K .......... .......... .......... .......... .......... 53% 259M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39700K .......... .......... .......... .......... .......... 54% 279M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39750K .......... .......... .......... .......... .......... 54% 269M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39800K .......... .......... .......... .......... .......... 54% 269M 0s 2019-11-27T15:24:32.464 INFO:teuthology.orchestra.run.smithi156.stderr: 39850K .......... .......... .......... .......... .......... 54% 298M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 39900K .......... .......... .......... .......... .......... 54% 281M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 39950K .......... .......... .......... .......... .......... 54% 236M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 40000K .......... .......... .......... .......... .......... 54% 283M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 40050K .......... .......... .......... .......... .......... 54% 287M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 40100K .......... .......... .......... .......... .......... 54% 285M 0s 2019-11-27T15:24:32.465 INFO:teuthology.orchestra.run.smithi156.stderr: 40150K .......... .......... .......... .......... .......... 54% 252M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40200K .......... .......... .......... .......... .......... 54% 262M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40250K .......... .......... .......... .......... .......... 54% 290M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40300K .......... .......... .......... .......... .......... 54% 278M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40350K .......... .......... .......... .......... .......... 54% 243M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40400K .......... .......... .......... .......... .......... 54% 306M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40450K .......... .......... .......... .......... .......... 55% 293M 0s 2019-11-27T15:24:32.466 INFO:teuthology.orchestra.run.smithi156.stderr: 40500K .......... .......... .......... .......... .......... 55% 307M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40550K .......... .......... .......... .......... .......... 55% 270M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40600K .......... .......... .......... .......... .......... 55% 294M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40650K .......... .......... .......... .......... .......... 55% 302M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40700K .......... .......... .......... .......... .......... 55% 292M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40750K .......... .......... .......... .......... .......... 55% 212M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40800K .......... .......... .......... .......... .......... 55% 229M 0s 2019-11-27T15:24:32.467 INFO:teuthology.orchestra.run.smithi156.stderr: 40850K .......... .......... .......... .......... .......... 55% 241M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 40900K .......... .......... .......... .......... .......... 55% 294M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 40950K .......... .......... .......... .......... .......... 55% 267M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 41000K .......... .......... .......... .......... .......... 55% 295M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 41050K .......... .......... .......... .......... .......... 55% 275M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 41100K .......... .......... .......... .......... .......... 55% 288M 0s 2019-11-27T15:24:32.468 INFO:teuthology.orchestra.run.smithi156.stderr: 41150K .......... .......... .......... .......... .......... 56% 239M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41200K .......... .......... .......... .......... .......... 56% 275M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41250K .......... .......... .......... .......... .......... 56% 255M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41300K .......... .......... .......... .......... .......... 56% 242M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41350K .......... .......... .......... .......... .......... 56% 240M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41400K .......... .......... .......... .......... .......... 56% 222M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41450K .......... .......... .......... .......... .......... 56% 247M 0s 2019-11-27T15:24:32.469 INFO:teuthology.orchestra.run.smithi156.stderr: 41500K .......... .......... .......... .......... .......... 56% 254M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41550K .......... .......... .......... .......... .......... 56% 236M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41600K .......... .......... .......... .......... .......... 56% 289M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41650K .......... .......... .......... .......... .......... 56% 279M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41700K .......... .......... .......... .......... .......... 56% 286M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41750K .......... .......... .......... .......... .......... 56% 270M 0s 2019-11-27T15:24:32.470 INFO:teuthology.orchestra.run.smithi156.stderr: 41800K .......... .......... .......... .......... .......... 56% 303M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 41850K .......... .......... .......... .......... .......... 56% 294M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 41900K .......... .......... .......... .......... .......... 57% 285M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 41950K .......... .......... .......... .......... .......... 57% 252M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 42000K .......... .......... .......... .......... .......... 57% 302M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 42050K .......... .......... .......... .......... .......... 57% 253M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 42100K .......... .......... .......... .......... .......... 57% 297M 0s 2019-11-27T15:24:32.471 INFO:teuthology.orchestra.run.smithi156.stderr: 42150K .......... .......... .......... .......... .......... 57% 186M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42200K .......... .......... .......... .......... .......... 57% 266M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42250K .......... .......... .......... .......... .......... 57% 299M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42300K .......... .......... .......... .......... .......... 57% 298M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42350K .......... .......... .......... .......... .......... 57% 251M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42400K .......... .......... .......... .......... .......... 57% 299M 0s 2019-11-27T15:24:32.472 INFO:teuthology.orchestra.run.smithi156.stderr: 42450K .......... .......... .......... .......... .......... 57% 293M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42500K .......... .......... .......... .......... .......... 57% 303M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42550K .......... .......... .......... .......... .......... 57% 278M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42600K .......... .......... .......... .......... .......... 57% 297M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42650K .......... .......... .......... .......... .......... 58% 302M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42700K .......... .......... .......... .......... .......... 58% 288M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42750K .......... .......... .......... .......... .......... 58% 237M 0s 2019-11-27T15:24:32.473 INFO:teuthology.orchestra.run.smithi156.stderr: 42800K .......... .......... .......... .......... .......... 58% 300M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 42850K .......... .......... .......... .......... .......... 58% 293M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 42900K .......... .......... .......... .......... .......... 58% 288M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 42950K .......... .......... .......... .......... .......... 58% 236M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 43000K .......... .......... .......... .......... .......... 58% 287M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 43050K .......... .......... .......... .......... .......... 58% 266M 0s 2019-11-27T15:24:32.474 INFO:teuthology.orchestra.run.smithi156.stderr: 43100K .......... .......... .......... .......... .......... 58% 242M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43150K .......... .......... .......... .......... .......... 58% 212M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43200K .......... .......... .......... .......... .......... 58% 271M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43250K .......... .......... .......... .......... .......... 58% 233M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43300K .......... .......... .......... .......... .......... 58% 282M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43350K .......... .......... .......... .......... .......... 59% 270M 0s 2019-11-27T15:24:32.475 INFO:teuthology.orchestra.run.smithi156.stderr: 43400K .......... .......... .......... .......... .......... 59% 306M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43450K .......... .......... .......... .......... .......... 59% 301M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43500K .......... .......... .......... .......... .......... 59% 299M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43550K .......... .......... .......... .......... .......... 59% 228M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43600K .......... .......... .......... .......... .......... 59% 300M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43650K .......... .......... .......... .......... .......... 59% 294M 0s 2019-11-27T15:24:32.476 INFO:teuthology.orchestra.run.smithi156.stderr: 43700K .......... .......... .......... .......... .......... 59% 272M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 43750K .......... .......... .......... .......... .......... 59% 264M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 43800K .......... .......... .......... .......... .......... 59% 291M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 43850K .......... .......... .......... .......... .......... 59% 288M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 43900K .......... .......... .......... .......... .......... 59% 298M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 43950K .......... .......... .......... .......... .......... 59% 247M 0s 2019-11-27T15:24:32.477 INFO:teuthology.orchestra.run.smithi156.stderr: 44000K .......... .......... .......... .......... .......... 59% 281M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44050K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44100K .......... .......... .......... .......... .......... 60% 286M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44150K .......... .......... .......... .......... .......... 60% 265M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44200K .......... .......... .......... .......... .......... 60% 297M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44250K .......... .......... .......... .......... .......... 60% 294M 0s 2019-11-27T15:24:32.478 INFO:teuthology.orchestra.run.smithi156.stderr: 44300K .......... .......... .......... .......... .......... 60% 304M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44350K .......... .......... .......... .......... .......... 60% 243M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44400K .......... .......... .......... .......... .......... 60% 285M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44450K .......... .......... .......... .......... .......... 60% 290M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44500K .......... .......... .......... .......... .......... 60% 302M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44550K .......... .......... .......... .......... .......... 60% 268M 0s 2019-11-27T15:24:32.479 INFO:teuthology.orchestra.run.smithi156.stderr: 44600K .......... .......... .......... .......... .......... 60% 297M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44650K .......... .......... .......... .......... .......... 60% 309M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44700K .......... .......... .......... .......... .......... 60% 293M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44750K .......... .......... .......... .......... .......... 60% 203M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44800K .......... .......... .......... .......... .......... 60% 254M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44850K .......... .......... .......... .......... .......... 61% 238M 0s 2019-11-27T15:24:32.480 INFO:teuthology.orchestra.run.smithi156.stderr: 44900K .......... .......... .......... .......... .......... 61% 280M 0s 2019-11-27T15:24:32.481 INFO:teuthology.orchestra.run.smithi156.stderr: 44950K .......... .......... .......... .......... .......... 61% 263M 0s 2019-11-27T15:24:32.481 INFO:teuthology.orchestra.run.smithi156.stderr: 45000K .......... .......... .......... .......... .......... 61% 285M 0s 2019-11-27T15:24:32.483 INFO:teuthology.orchestra.run.smithi156.stderr: 45050K .......... .......... .......... .......... .......... 61% 279M 0s 2019-11-27T15:24:32.483 INFO:teuthology.orchestra.run.smithi156.stderr: 45100K .......... .......... .......... .......... .......... 61% 281M 0s 2019-11-27T15:24:32.483 INFO:teuthology.orchestra.run.smithi156.stderr: 45150K .......... .......... .......... .......... .......... 61% 234M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45200K .......... .......... .......... .......... .......... 61% 281M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45250K .......... .......... .......... .......... .......... 61% 271M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45300K .......... .......... .......... .......... .......... 61% 294M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45350K .......... .......... .......... .......... .......... 61% 254M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45400K .......... .......... .......... .......... .......... 61% 263M 0s 2019-11-27T15:24:32.484 INFO:teuthology.orchestra.run.smithi156.stderr: 45450K .......... .......... .......... .......... .......... 61% 274M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45500K .......... .......... .......... .......... .......... 61% 267M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45550K .......... .......... .......... .......... .......... 61% 234M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45600K .......... .......... .......... .......... .......... 62% 310M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45650K .......... .......... .......... .......... .......... 62% 291M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45700K .......... .......... .......... .......... .......... 62% 307M 0s 2019-11-27T15:24:32.485 INFO:teuthology.orchestra.run.smithi156.stderr: 45750K .......... .......... .......... .......... .......... 62% 268M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 45800K .......... .......... .......... .......... .......... 62% 292M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 45850K .......... .......... .......... .......... .......... 62% 301M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 45900K .......... .......... .......... .......... .......... 62% 296M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 45950K .......... .......... .......... .......... .......... 62% 243M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 46000K .......... .......... .......... .......... .......... 62% 286M 0s 2019-11-27T15:24:32.486 INFO:teuthology.orchestra.run.smithi156.stderr: 46050K .......... .......... .......... .......... .......... 62% 279M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46100K .......... .......... .......... .......... .......... 62% 226M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46150K .......... .......... .......... .......... .......... 62% 234M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46200K .......... .......... .......... .......... .......... 62% 271M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46250K .......... .......... .......... .......... .......... 62% 261M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46300K .......... .......... .......... .......... .......... 63% 270M 0s 2019-11-27T15:24:32.487 INFO:teuthology.orchestra.run.smithi156.stderr: 46350K .......... .......... .......... .......... .......... 63% 242M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46400K .......... .......... .......... .......... .......... 63% 286M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46450K .......... .......... .......... .......... .......... 63% 296M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46500K .......... .......... .......... .......... .......... 63% 288M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46550K .......... .......... .......... .......... .......... 63% 279M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46600K .......... .......... .......... .......... .......... 63% 294M 0s 2019-11-27T15:24:32.488 INFO:teuthology.orchestra.run.smithi156.stderr: 46650K .......... .......... .......... .......... .......... 63% 283M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46700K .......... .......... .......... .......... .......... 63% 283M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46750K .......... .......... .......... .......... .......... 63% 236M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46800K .......... .......... .......... .......... .......... 63% 286M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46850K .......... .......... .......... .......... .......... 63% 277M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46900K .......... .......... .......... .......... .......... 63% 296M 0s 2019-11-27T15:24:32.489 INFO:teuthology.orchestra.run.smithi156.stderr: 46950K .......... .......... .......... .......... .......... 63% 242M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47000K .......... .......... .......... .......... .......... 63% 295M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47050K .......... .......... .......... .......... .......... 64% 294M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47100K .......... .......... .......... .......... .......... 64% 292M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47150K .......... .......... .......... .......... .......... 64% 246M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47200K .......... .......... .......... .......... .......... 64% 274M 0s 2019-11-27T15:24:32.490 INFO:teuthology.orchestra.run.smithi156.stderr: 47250K .......... .......... .......... .......... .......... 64% 285M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47300K .......... .......... .......... .......... .......... 64% 292M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47350K .......... .......... .......... .......... .......... 64% 271M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47400K .......... .......... .......... .......... .......... 64% 309M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47450K .......... .......... .......... .......... .......... 64% 306M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47500K .......... .......... .......... .......... .......... 64% 292M 0s 2019-11-27T15:24:32.491 INFO:teuthology.orchestra.run.smithi156.stderr: 47550K .......... .......... .......... .......... .......... 64% 242M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47600K .......... .......... .......... .......... .......... 64% 294M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47650K .......... .......... .......... .......... .......... 64% 273M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47700K .......... .......... .......... .......... .......... 64% 297M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47750K .......... .......... .......... .......... .......... 64% 216M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47800K .......... .......... .......... .......... .......... 65% 275M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47850K .......... .......... .......... .......... .......... 65% 308M 0s 2019-11-27T15:24:32.492 INFO:teuthology.orchestra.run.smithi156.stderr: 47900K .......... .......... .......... .......... .......... 65% 294M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 47950K .......... .......... .......... .......... .......... 65% 247M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48000K .......... .......... .......... .......... .......... 65% 304M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48050K .......... .......... .......... .......... .......... 65% 280M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48100K .......... .......... .......... .......... .......... 65% 278M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48150K .......... .......... .......... .......... .......... 65% 268M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48200K .......... .......... .......... .......... .......... 65% 280M 0s 2019-11-27T15:24:32.493 INFO:teuthology.orchestra.run.smithi156.stderr: 48250K .......... .......... .......... .......... .......... 65% 289M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48300K .......... .......... .......... .......... .......... 65% 282M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48350K .......... .......... .......... .......... .......... 65% 234M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48400K .......... .......... .......... .......... .......... 65% 288M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48450K .......... .......... .......... .......... .......... 65% 299M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48500K .......... .......... .......... .......... .......... 66% 276M 0s 2019-11-27T15:24:32.494 INFO:teuthology.orchestra.run.smithi156.stderr: 48550K .......... .......... .......... .......... .......... 66% 242M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48600K .......... .......... .......... .......... .......... 66% 277M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48650K .......... .......... .......... .......... .......... 66% 297M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48700K .......... .......... .......... .......... .......... 66% 285M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48750K .......... .......... .......... .......... .......... 66% 227M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48800K .......... .......... .......... .......... .......... 66% 277M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48850K .......... .......... .......... .......... .......... 66% 283M 0s 2019-11-27T15:24:32.495 INFO:teuthology.orchestra.run.smithi156.stderr: 48900K .......... .......... .......... .......... .......... 66% 285M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 48950K .......... .......... .......... .......... .......... 66% 271M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 49000K .......... .......... .......... .......... .......... 66% 303M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 49050K .......... .......... .......... .......... .......... 66% 293M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 49100K .......... .......... .......... .......... .......... 66% 285M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 49150K .......... .......... .......... .......... .......... 66% 222M 0s 2019-11-27T15:24:32.496 INFO:teuthology.orchestra.run.smithi156.stderr: 49200K .......... .......... .......... .......... .......... 66% 242M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49250K .......... .......... .......... .......... .......... 67% 304M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49300K .......... .......... .......... .......... .......... 67% 237M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49350K .......... .......... .......... .......... .......... 67% 208M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49400K .......... .......... .......... .......... .......... 67% 289M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49450K .......... .......... .......... .......... .......... 67% 260M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49500K .......... .......... .......... .......... .......... 67% 252M 0s 2019-11-27T15:24:32.497 INFO:teuthology.orchestra.run.smithi156.stderr: 49550K .......... .......... .......... .......... .......... 67% 240M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49600K .......... .......... .......... .......... .......... 67% 285M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49650K .......... .......... .......... .......... .......... 67% 287M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49700K .......... .......... .......... .......... .......... 67% 230M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49750K .......... .......... .......... .......... .......... 67% 260M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49800K .......... .......... .......... .......... .......... 67% 242M 0s 2019-11-27T15:24:32.498 INFO:teuthology.orchestra.run.smithi156.stderr: 49850K .......... .......... .......... .......... .......... 67% 253M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 49900K .......... .......... .......... .......... .......... 67% 274M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 49950K .......... .......... .......... .......... .......... 67% 190M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 50000K .......... .......... .......... .......... .......... 68% 294M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 50050K .......... .......... .......... .......... .......... 68% 228M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 50100K .......... .......... .......... .......... .......... 68% 286M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 50150K .......... .......... .......... .......... .......... 68% 264M 0s 2019-11-27T15:24:32.499 INFO:teuthology.orchestra.run.smithi156.stderr: 50200K .......... .......... .......... .......... .......... 68% 291M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50250K .......... .......... .......... .......... .......... 68% 281M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50300K .......... .......... .......... .......... .......... 68% 293M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50350K .......... .......... .......... .......... .......... 68% 235M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50400K .......... .......... .......... .......... .......... 68% 298M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50450K .......... .......... .......... .......... .......... 68% 298M 0s 2019-11-27T15:24:32.500 INFO:teuthology.orchestra.run.smithi156.stderr: 50500K .......... .......... .......... .......... .......... 68% 293M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50550K .......... .......... .......... .......... .......... 68% 265M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50600K .......... .......... .......... .......... .......... 68% 292M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50650K .......... .......... .......... .......... .......... 68% 299M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50700K .......... .......... .......... .......... .......... 68% 286M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50750K .......... .......... .......... .......... .......... 69% 232M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50800K .......... .......... .......... .......... .......... 69% 286M 0s 2019-11-27T15:24:32.501 INFO:teuthology.orchestra.run.smithi156.stderr: 50850K .......... .......... .......... .......... .......... 69% 284M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 50900K .......... .......... .......... .......... .......... 69% 275M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 50950K .......... .......... .......... .......... .......... 69% 266M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 51000K .......... .......... .......... .......... .......... 69% 308M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 51050K .......... .......... .......... .......... .......... 69% 287M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 51100K .......... .......... .......... .......... .......... 69% 296M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 51150K .......... .......... .......... .......... .......... 69% 219M 0s 2019-11-27T15:24:32.502 INFO:teuthology.orchestra.run.smithi156.stderr: 51200K .......... .......... .......... .......... .......... 69% 270M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51250K .......... .......... .......... .......... .......... 69% 296M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51300K .......... .......... .......... .......... .......... 69% 242M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51350K .......... .......... .......... .......... .......... 69% 209M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51400K .......... .......... .......... .......... .......... 69% 287M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51450K .......... .......... .......... .......... .......... 70% 259M 0s 2019-11-27T15:24:32.503 INFO:teuthology.orchestra.run.smithi156.stderr: 51500K .......... .......... .......... .......... .......... 70% 300M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51550K .......... .......... .......... .......... .......... 70% 244M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51600K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51650K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51700K .......... .......... .......... .......... .......... 70% 308M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51750K .......... .......... .......... .......... .......... 70% 270M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51800K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-27T15:24:32.504 INFO:teuthology.orchestra.run.smithi156.stderr: 51850K .......... .......... .......... .......... .......... 70% 297M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 51900K .......... .......... .......... .......... .......... 70% 287M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 51950K .......... .......... .......... .......... .......... 70% 250M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 52000K .......... .......... .......... .......... .......... 70% 291M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 52050K .......... .......... .......... .......... .......... 70% 289M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 52100K .......... .......... .......... .......... .......... 70% 295M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 52150K .......... .......... .......... .......... .......... 70% 249M 0s 2019-11-27T15:24:32.505 INFO:teuthology.orchestra.run.smithi156.stderr: 52200K .......... .......... .......... .......... .......... 71% 293M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52250K .......... .......... .......... .......... .......... 71% 281M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52300K .......... .......... .......... .......... .......... 71% 291M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52350K .......... .......... .......... .......... .......... 71% 237M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52400K .......... .......... .......... .......... .......... 71% 287M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52450K .......... .......... .......... .......... .......... 71% 275M 0s 2019-11-27T15:24:32.506 INFO:teuthology.orchestra.run.smithi156.stderr: 52500K .......... .......... .......... .......... .......... 71% 299M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52550K .......... .......... .......... .......... .......... 71% 277M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52600K .......... .......... .......... .......... .......... 71% 300M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52650K .......... .......... .......... .......... .......... 71% 300M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52700K .......... .......... .......... .......... .......... 71% 293M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52750K .......... .......... .......... .......... .......... 71% 241M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52800K .......... .......... .......... .......... .......... 71% 291M 0s 2019-11-27T15:24:32.507 INFO:teuthology.orchestra.run.smithi156.stderr: 52850K .......... .......... .......... .......... .......... 71% 284M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 52900K .......... .......... .......... .......... .......... 71% 288M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 52950K .......... .......... .......... .......... .......... 72% 258M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 53000K .......... .......... .......... .......... .......... 72% 247M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 53050K .......... .......... .......... .......... .......... 72% 240M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 53100K .......... .......... .......... .......... .......... 72% 295M 0s 2019-11-27T15:24:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: 53150K .......... .......... .......... .......... .......... 72% 210M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53200K .......... .......... .......... .......... .......... 72% 277M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53250K .......... .......... .......... .......... .......... 72% 293M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53300K .......... .......... .......... .......... .......... 72% 306M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53350K .......... .......... .......... .......... .......... 72% 263M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53400K .......... .......... .......... .......... .......... 72% 293M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53450K .......... .......... .......... .......... .......... 72% 313M 0s 2019-11-27T15:24:32.509 INFO:teuthology.orchestra.run.smithi156.stderr: 53500K .......... .......... .......... .......... .......... 72% 299M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53550K .......... .......... .......... .......... .......... 72% 247M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53600K .......... .......... .......... .......... .......... 72% 294M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53650K .......... .......... .......... .......... .......... 73% 281M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53700K .......... .......... .......... .......... .......... 73% 288M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53750K .......... .......... .......... .......... .......... 73% 263M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53800K .......... .......... .......... .......... .......... 73% 311M 0s 2019-11-27T15:24:32.510 INFO:teuthology.orchestra.run.smithi156.stderr: 53850K .......... .......... .......... .......... .......... 73% 280M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 53900K .......... .......... .......... .......... .......... 73% 274M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 53950K .......... .......... .......... .......... .......... 73% 248M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 54000K .......... .......... .......... .......... .......... 73% 284M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 54050K .......... .......... .......... .......... .......... 73% 282M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 54100K .......... .......... .......... .......... .......... 73% 295M 0s 2019-11-27T15:24:32.511 INFO:teuthology.orchestra.run.smithi156.stderr: 54150K .......... .......... .......... .......... .......... 73% 252M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54200K .......... .......... .......... .......... .......... 73% 310M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54250K .......... .......... .......... .......... .......... 73% 303M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54300K .......... .......... .......... .......... .......... 73% 310M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54350K .......... .......... .......... .......... .......... 73% 228M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54400K .......... .......... .......... .......... .......... 74% 300M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54450K .......... .......... .......... .......... .......... 74% 237M 0s 2019-11-27T15:24:32.512 INFO:teuthology.orchestra.run.smithi156.stderr: 54500K .......... .......... .......... .......... .......... 74% 271M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54550K .......... .......... .......... .......... .......... 74% 217M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54600K .......... .......... .......... .......... .......... 74% 243M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54650K .......... .......... .......... .......... .......... 74% 279M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54700K .......... .......... .......... .......... .......... 74% 249M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54750K .......... .......... .......... .......... .......... 74% 192M 0s 2019-11-27T15:24:32.513 INFO:teuthology.orchestra.run.smithi156.stderr: 54800K .......... .......... .......... .......... .......... 74% 270M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 54850K .......... .......... .......... .......... .......... 74% 289M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 54900K .......... .......... .......... .......... .......... 74% 292M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 54950K .......... .......... .......... .......... .......... 74% 256M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 55000K .......... .......... .......... .......... .......... 74% 290M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 55050K .......... .......... .......... .......... .......... 74% 305M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 55100K .......... .......... .......... .......... .......... 74% 295M 0s 2019-11-27T15:24:32.514 INFO:teuthology.orchestra.run.smithi156.stderr: 55150K .......... .......... .......... .......... .......... 75% 254M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55200K .......... .......... .......... .......... .......... 75% 301M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55250K .......... .......... .......... .......... .......... 75% 280M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55300K .......... .......... .......... .......... .......... 75% 300M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55350K .......... .......... .......... .......... .......... 75% 275M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55400K .......... .......... .......... .......... .......... 75% 304M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55450K .......... .......... .......... .......... .......... 75% 298M 0s 2019-11-27T15:24:32.515 INFO:teuthology.orchestra.run.smithi156.stderr: 55500K .......... .......... .......... .......... .......... 75% 289M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55550K .......... .......... .......... .......... .......... 75% 228M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55600K .......... .......... .......... .......... .......... 75% 288M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55650K .......... .......... .......... .......... .......... 75% 285M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55700K .......... .......... .......... .......... .......... 75% 288M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55750K .......... .......... .......... .......... .......... 75% 268M 0s 2019-11-27T15:24:32.516 INFO:teuthology.orchestra.run.smithi156.stderr: 55800K .......... .......... .......... .......... .......... 75% 287M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 55850K .......... .......... .......... .......... .......... 75% 314M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 55900K .......... .......... .......... .......... .......... 76% 273M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 55950K .......... .......... .......... .......... .......... 76% 246M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 56000K .......... .......... .......... .......... .......... 76% 301M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 56050K .......... .......... .......... .......... .......... 76% 289M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 56100K .......... .......... .......... .......... .......... 76% 292M 0s 2019-11-27T15:24:32.517 INFO:teuthology.orchestra.run.smithi156.stderr: 56150K .......... .......... .......... .......... .......... 76% 291M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56200K .......... .......... .......... .......... .......... 76% 301M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56250K .......... .......... .......... .......... .......... 76% 310M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56300K .......... .......... .......... .......... .......... 76% 292M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56350K .......... .......... .......... .......... .......... 76% 201M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56400K .......... .......... .......... .......... .......... 76% 276M 0s 2019-11-27T15:24:32.518 INFO:teuthology.orchestra.run.smithi156.stderr: 56450K .......... .......... .......... .......... .......... 76% 281M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56500K .......... .......... .......... .......... .......... 76% 290M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56550K .......... .......... .......... .......... .......... 76% 237M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56600K .......... .......... .......... .......... .......... 77% 291M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56650K .......... .......... .......... .......... .......... 77% 285M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56700K .......... .......... .......... .......... .......... 77% 288M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56750K .......... .......... .......... .......... .......... 77% 258M 0s 2019-11-27T15:24:32.519 INFO:teuthology.orchestra.run.smithi156.stderr: 56800K .......... .......... .......... .......... .......... 77% 284M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 56850K .......... .......... .......... .......... .......... 77% 231M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 56900K .......... .......... .......... .......... .......... 77% 264M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 56950K .......... .......... .......... .......... .......... 77% 254M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 57000K .......... .......... .......... .......... .......... 77% 283M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 57050K .......... .......... .......... .......... .......... 77% 309M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 57100K .......... .......... .......... .......... .......... 77% 288M 0s 2019-11-27T15:24:32.520 INFO:teuthology.orchestra.run.smithi156.stderr: 57150K .......... .......... .......... .......... .......... 77% 252M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57200K .......... .......... .......... .......... .......... 77% 285M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57250K .......... .......... .......... .......... .......... 77% 287M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57300K .......... .......... .......... .......... .......... 77% 298M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57350K .......... .......... .......... .......... .......... 78% 268M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57400K .......... .......... .......... .......... .......... 78% 296M 0s 2019-11-27T15:24:32.521 INFO:teuthology.orchestra.run.smithi156.stderr: 57450K .......... .......... .......... .......... .......... 78% 283M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57500K .......... .......... .......... .......... .......... 78% 298M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57550K .......... .......... .......... .......... .......... 78% 249M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57600K .......... .......... .......... .......... .......... 78% 299M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57650K .......... .......... .......... .......... .......... 78% 283M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57700K .......... .......... .......... .......... .......... 78% 292M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57750K .......... .......... .......... .......... .......... 78% 251M 0s 2019-11-27T15:24:32.522 INFO:teuthology.orchestra.run.smithi156.stderr: 57800K .......... .......... .......... .......... .......... 78% 288M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 57850K .......... .......... .......... .......... .......... 78% 289M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 57900K .......... .......... .......... .......... .......... 78% 285M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 57950K .......... .......... .......... .......... .......... 78% 250M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 58000K .......... .......... .......... .......... .......... 78% 272M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 58050K .......... .......... .......... .......... .......... 78% 238M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 58100K .......... .......... .......... .......... .......... 79% 234M 0s 2019-11-27T15:24:32.523 INFO:teuthology.orchestra.run.smithi156.stderr: 58150K .......... .......... .......... .......... .......... 79% 258M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58200K .......... .......... .......... .......... .......... 79% 254M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58250K .......... .......... .......... .......... .......... 79% 290M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58300K .......... .......... .......... .......... .......... 79% 270M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58350K .......... .......... .......... .......... .......... 79% 196M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58400K .......... .......... .......... .......... .......... 79% 260M 0s 2019-11-27T15:24:32.524 INFO:teuthology.orchestra.run.smithi156.stderr: 58450K .......... .......... .......... .......... .......... 79% 283M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58500K .......... .......... .......... .......... .......... 79% 297M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58550K .......... .......... .......... .......... .......... 79% 271M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58600K .......... .......... .......... .......... .......... 79% 295M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58650K .......... .......... .......... .......... .......... 79% 297M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58700K .......... .......... .......... .......... .......... 79% 291M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58750K .......... .......... .......... .......... .......... 79% 234M 0s 2019-11-27T15:24:32.525 INFO:teuthology.orchestra.run.smithi156.stderr: 58800K .......... .......... .......... .......... .......... 80% 296M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 58850K .......... .......... .......... .......... .......... 80% 291M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 58900K .......... .......... .......... .......... .......... 80% 263M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 58950K .......... .......... .......... .......... .......... 80% 269M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 59000K .......... .......... .......... .......... .......... 80% 285M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 59050K .......... .......... .......... .......... .......... 80% 299M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 59100K .......... .......... .......... .......... .......... 80% 289M 0s 2019-11-27T15:24:32.526 INFO:teuthology.orchestra.run.smithi156.stderr: 59150K .......... .......... .......... .......... .......... 80% 228M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59200K .......... .......... .......... .......... .......... 80% 250M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59250K .......... .......... .......... .......... .......... 80% 251M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59300K .......... .......... .......... .......... .......... 80% 232M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59350K .......... .......... .......... .......... .......... 80% 261M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59400K .......... .......... .......... .......... .......... 80% 250M 0s 2019-11-27T15:24:32.527 INFO:teuthology.orchestra.run.smithi156.stderr: 59450K .......... .......... .......... .......... .......... 80% 273M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59500K .......... .......... .......... .......... .......... 80% 258M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59550K .......... .......... .......... .......... .......... 81% 246M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59600K .......... .......... .......... .......... .......... 81% 291M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59650K .......... .......... .......... .......... .......... 81% 282M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59700K .......... .......... .......... .......... .......... 81% 280M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59750K .......... .......... .......... .......... .......... 81% 249M 0s 2019-11-27T15:24:32.528 INFO:teuthology.orchestra.run.smithi156.stderr: 59800K .......... .......... .......... .......... .......... 81% 284M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 59850K .......... .......... .......... .......... .......... 81% 291M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 59900K .......... .......... .......... .......... .......... 81% 269M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 59950K .......... .......... .......... .......... .......... 81% 221M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 60000K .......... .......... .......... .......... .......... 81% 232M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 60050K .......... .......... .......... .......... .......... 81% 257M 0s 2019-11-27T15:24:32.529 INFO:teuthology.orchestra.run.smithi156.stderr: 60100K .......... .......... .......... .......... .......... 81% 251M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60150K .......... .......... .......... .......... .......... 81% 242M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60200K .......... .......... .......... .......... .......... 81% 268M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60250K .......... .......... .......... .......... .......... 81% 311M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60300K .......... .......... .......... .......... .......... 82% 308M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60350K .......... .......... .......... .......... .......... 82% 245M 0s 2019-11-27T15:24:32.530 INFO:teuthology.orchestra.run.smithi156.stderr: 60400K .......... .......... .......... .......... .......... 82% 305M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60450K .......... .......... .......... .......... .......... 82% 291M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60500K .......... .......... .......... .......... .......... 82% 271M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60550K .......... .......... .......... .......... .......... 82% 276M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60600K .......... .......... .......... .......... .......... 82% 302M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60650K .......... .......... .......... .......... .......... 82% 304M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60700K .......... .......... .......... .......... .......... 82% 303M 0s 2019-11-27T15:24:32.531 INFO:teuthology.orchestra.run.smithi156.stderr: 60750K .......... .......... .......... .......... .......... 82% 257M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 60800K .......... .......... .......... .......... .......... 82% 295M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 60850K .......... .......... .......... .......... .......... 82% 290M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 60900K .......... .......... .......... .......... .......... 82% 294M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 60950K .......... .......... .......... .......... .......... 82% 262M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 61000K .......... .......... .......... .......... .......... 82% 286M 0s 2019-11-27T15:24:32.532 INFO:teuthology.orchestra.run.smithi156.stderr: 61050K .......... .......... .......... .......... .......... 83% 294M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61100K .......... .......... .......... .......... .......... 83% 287M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61150K .......... .......... .......... .......... .......... 83% 241M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61200K .......... .......... .......... .......... .......... 83% 282M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61250K .......... .......... .......... .......... .......... 83% 290M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61300K .......... .......... .......... .......... .......... 83% 297M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61350K .......... .......... .......... .......... .......... 83% 274M 0s 2019-11-27T15:24:32.533 INFO:teuthology.orchestra.run.smithi156.stderr: 61400K .......... .......... .......... .......... .......... 83% 288M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61450K .......... .......... .......... .......... .......... 83% 277M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61500K .......... .......... .......... .......... .......... 83% 274M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61550K .......... .......... .......... .......... .......... 83% 228M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61600K .......... .......... .......... .......... .......... 83% 255M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61650K .......... .......... .......... .......... .......... 83% 265M 0s 2019-11-27T15:24:32.534 INFO:teuthology.orchestra.run.smithi156.stderr: 61700K .......... .......... .......... .......... .......... 83% 256M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 61750K .......... .......... .......... .......... .......... 84% 250M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 61800K .......... .......... .......... .......... .......... 84% 271M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 61850K .......... .......... .......... .......... .......... 84% 263M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 61900K .......... .......... .......... .......... .......... 84% 280M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 61950K .......... .......... .......... .......... .......... 84% 235M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 62000K .......... .......... .......... .......... .......... 84% 291M 0s 2019-11-27T15:24:32.535 INFO:teuthology.orchestra.run.smithi156.stderr: 62050K .......... .......... .......... .......... .......... 84% 287M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62100K .......... .......... .......... .......... .......... 84% 285M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62150K .......... .......... .......... .......... .......... 84% 253M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62200K .......... .......... .......... .......... .......... 84% 285M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62250K .......... .......... .......... .......... .......... 84% 301M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62300K .......... .......... .......... .......... .......... 84% 286M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62350K .......... .......... .......... .......... .......... 84% 243M 0s 2019-11-27T15:24:32.536 INFO:teuthology.orchestra.run.smithi156.stderr: 62400K .......... .......... .......... .......... .......... 84% 283M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62450K .......... .......... .......... .......... .......... 84% 282M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62500K .......... .......... .......... .......... .......... 85% 253M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62550K .......... .......... .......... .......... .......... 85% 267M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62600K .......... .......... .......... .......... .......... 85% 305M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62650K .......... .......... .......... .......... .......... 85% 311M 0s 2019-11-27T15:24:32.537 INFO:teuthology.orchestra.run.smithi156.stderr: 62700K .......... .......... .......... .......... .......... 85% 243M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 62750K .......... .......... .......... .......... .......... 85% 214M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 62800K .......... .......... .......... .......... .......... 85% 294M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 62850K .......... .......... .......... .......... .......... 85% 290M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 62900K .......... .......... .......... .......... .......... 85% 295M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 62950K .......... .......... .......... .......... .......... 85% 270M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 63000K .......... .......... .......... .......... .......... 85% 294M 0s 2019-11-27T15:24:32.538 INFO:teuthology.orchestra.run.smithi156.stderr: 63050K .......... .......... .......... .......... .......... 85% 298M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63100K .......... .......... .......... .......... .......... 85% 304M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63150K .......... .......... .......... .......... .......... 85% 239M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63200K .......... .......... .......... .......... .......... 85% 290M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63250K .......... .......... .......... .......... .......... 86% 301M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63300K .......... .......... .......... .......... .......... 86% 280M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63350K .......... .......... .......... .......... .......... 86% 254M 0s 2019-11-27T15:24:32.539 INFO:teuthology.orchestra.run.smithi156.stderr: 63400K .......... .......... .......... .......... .......... 86% 297M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63450K .......... .......... .......... .......... .......... 86% 309M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63500K .......... .......... .......... .......... .......... 86% 294M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63550K .......... .......... .......... .......... .......... 86% 246M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63600K .......... .......... .......... .......... .......... 86% 290M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63650K .......... .......... .......... .......... .......... 86% 281M 0s 2019-11-27T15:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr: 63700K .......... .......... .......... .......... .......... 86% 306M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 63750K .......... .......... .......... .......... .......... 86% 273M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 63800K .......... .......... .......... .......... .......... 86% 298M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 63850K .......... .......... .......... .......... .......... 86% 304M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 63900K .......... .......... .......... .......... .......... 86% 268M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 63950K .......... .......... .......... .......... .......... 87% 199M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 64000K .......... .......... .......... .......... .......... 87% 298M 0s 2019-11-27T15:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr: 64050K .......... .......... .......... .......... .......... 87% 288M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64100K .......... .......... .......... .......... .......... 87% 297M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64150K .......... .......... .......... .......... .......... 87% 265M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64200K .......... .......... .......... .......... .......... 87% 300M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64250K .......... .......... .......... .......... .......... 87% 280M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64300K .......... .......... .......... .......... .......... 87% 290M 0s 2019-11-27T15:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr: 64350K .......... .......... .......... .......... .......... 87% 247M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64400K .......... .......... .......... .......... .......... 87% 282M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64450K .......... .......... .......... .......... .......... 87% 268M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64500K .......... .......... .......... .......... .......... 87% 295M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64550K .......... .......... .......... .......... .......... 87% 267M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64600K .......... .......... .......... .......... .......... 87% 272M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64650K .......... .......... .......... .......... .......... 87% 295M 0s 2019-11-27T15:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr: 64700K .......... .......... .......... .......... .......... 88% 297M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 64750K .......... .......... .......... .......... .......... 88% 246M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 64800K .......... .......... .......... .......... .......... 88% 299M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 64850K .......... .......... .......... .......... .......... 88% 232M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 64900K .......... .......... .......... .......... .......... 88% 244M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 64950K .......... .......... .......... .......... .......... 88% 231M 0s 2019-11-27T15:24:32.544 INFO:teuthology.orchestra.run.smithi156.stderr: 65000K .......... .......... .......... .......... .......... 88% 267M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65050K .......... .......... .......... .......... .......... 88% 297M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65100K .......... .......... .......... .......... .......... 88% 301M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65150K .......... .......... .......... .......... .......... 88% 247M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65200K .......... .......... .......... .......... .......... 88% 284M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65250K .......... .......... .......... .......... .......... 88% 280M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65300K .......... .......... .......... .......... .......... 88% 290M 0s 2019-11-27T15:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr: 65350K .......... .......... .......... .......... .......... 88% 260M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65400K .......... .......... .......... .......... .......... 88% 290M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65450K .......... .......... .......... .......... .......... 89% 287M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65500K .......... .......... .......... .......... .......... 89% 283M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65550K .......... .......... .......... .......... .......... 89% 235M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65600K .......... .......... .......... .......... .......... 89% 298M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65650K .......... .......... .......... .......... .......... 89% 297M 0s 2019-11-27T15:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr: 65700K .......... .......... .......... .......... .......... 89% 260M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 65750K .......... .......... .......... .......... .......... 89% 242M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 65800K .......... .......... .......... .......... .......... 89% 302M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 65850K .......... .......... .......... .......... .......... 89% 262M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 65900K .......... .......... .......... .......... .......... 89% 278M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 65950K .......... .......... .......... .......... .......... 89% 240M 0s 2019-11-27T15:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr: 66000K .......... .......... .......... .......... .......... 89% 295M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66050K .......... .......... .......... .......... .......... 89% 293M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66100K .......... .......... .......... .......... .......... 89% 304M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66150K .......... .......... .......... .......... .......... 89% 250M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66200K .......... .......... .......... .......... .......... 90% 294M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66250K .......... .......... .......... .......... .......... 90% 276M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66300K .......... .......... .......... .......... .......... 90% 295M 0s 2019-11-27T15:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr: 66350K .......... .......... .......... .......... .......... 90% 238M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66400K .......... .......... .......... .......... .......... 90% 284M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66450K .......... .......... .......... .......... .......... 90% 294M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66500K .......... .......... .......... .......... .......... 90% 278M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66550K .......... .......... .......... .......... .......... 90% 255M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66600K .......... .......... .......... .......... .......... 90% 302M 0s 2019-11-27T15:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr: 66650K .......... .......... .......... .......... .......... 90% 305M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66700K .......... .......... .......... .......... .......... 90% 289M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66750K .......... .......... .......... .......... .......... 90% 255M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66800K .......... .......... .......... .......... .......... 90% 298M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66850K .......... .......... .......... .......... .......... 90% 300M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66900K .......... .......... .......... .......... .......... 91% 288M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 66950K .......... .......... .......... .......... .......... 91% 257M 0s 2019-11-27T15:24:32.550 INFO:teuthology.orchestra.run.smithi156.stderr: 67000K .......... .......... .......... .......... .......... 91% 281M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67050K .......... .......... .......... .......... .......... 91% 308M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67100K .......... .......... .......... .......... .......... 91% 301M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67150K .......... .......... .......... .......... .......... 91% 235M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67200K .......... .......... .......... .......... .......... 91% 292M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67250K .......... .......... .......... .......... .......... 91% 293M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67300K .......... .......... .......... .......... .......... 91% 289M 0s 2019-11-27T15:24:32.551 INFO:teuthology.orchestra.run.smithi156.stderr: 67350K .......... .......... .......... .......... .......... 91% 269M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67400K .......... .......... .......... .......... .......... 91% 271M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67450K .......... .......... .......... .......... .......... 91% 305M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67500K .......... .......... .......... .......... .......... 91% 274M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67550K .......... .......... .......... .......... .......... 91% 240M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67600K .......... .......... .......... .......... .......... 91% 292M 0s 2019-11-27T15:24:32.552 INFO:teuthology.orchestra.run.smithi156.stderr: 67650K .......... .......... .......... .......... .......... 92% 297M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67700K .......... .......... .......... .......... .......... 92% 277M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67750K .......... .......... .......... .......... .......... 92% 260M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67800K .......... .......... .......... .......... .......... 92% 292M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67850K .......... .......... .......... .......... .......... 92% 289M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67900K .......... .......... .......... .......... .......... 92% 289M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 67950K .......... .......... .......... .......... .......... 92% 258M 0s 2019-11-27T15:24:32.553 INFO:teuthology.orchestra.run.smithi156.stderr: 68000K .......... .......... .......... .......... .......... 92% 289M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68050K .......... .......... .......... .......... .......... 92% 277M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68100K .......... .......... .......... .......... .......... 92% 295M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68150K .......... .......... .......... .......... .......... 92% 251M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68200K .......... .......... .......... .......... .......... 92% 296M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68250K .......... .......... .......... .......... .......... 92% 301M 0s 2019-11-27T15:24:32.554 INFO:teuthology.orchestra.run.smithi156.stderr: 68300K .......... .......... .......... .......... .......... 92% 288M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68350K .......... .......... .......... .......... .......... 92% 239M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68400K .......... .......... .......... .......... .......... 93% 295M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68450K .......... .......... .......... .......... .......... 93% 270M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68500K .......... .......... .......... .......... .......... 93% 240M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68550K .......... .......... .......... .......... .......... 93% 256M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68600K .......... .......... .......... .......... .......... 93% 301M 0s 2019-11-27T15:24:32.555 INFO:teuthology.orchestra.run.smithi156.stderr: 68650K .......... .......... .......... .......... .......... 93% 297M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68700K .......... .......... .......... .......... .......... 93% 285M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68750K .......... .......... .......... .......... .......... 93% 244M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68800K .......... .......... .......... .......... .......... 93% 284M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68850K .......... .......... .......... .......... .......... 93% 280M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68900K .......... .......... .......... .......... .......... 93% 288M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 68950K .......... .......... .......... .......... .......... 93% 262M 0s 2019-11-27T15:24:32.556 INFO:teuthology.orchestra.run.smithi156.stderr: 69000K .......... .......... .......... .......... .......... 93% 284M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69050K .......... .......... .......... .......... .......... 93% 291M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69100K .......... .......... .......... .......... .......... 94% 295M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69150K .......... .......... .......... .......... .......... 94% 222M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69200K .......... .......... .......... .......... .......... 94% 288M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69250K .......... .......... .......... .......... .......... 94% 275M 0s 2019-11-27T15:24:32.557 INFO:teuthology.orchestra.run.smithi156.stderr: 69300K .......... .......... .......... .......... .......... 94% 278M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69350K .......... .......... .......... .......... .......... 94% 258M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69400K .......... .......... .......... .......... .......... 94% 279M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69450K .......... .......... .......... .......... .......... 94% 284M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69500K .......... .......... .......... .......... .......... 94% 294M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69550K .......... .......... .......... .......... .......... 94% 199M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69600K .......... .......... .......... .......... .......... 94% 260M 0s 2019-11-27T15:24:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: 69650K .......... .......... .......... .......... .......... 94% 284M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69700K .......... .......... .......... .......... .......... 94% 267M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69750K .......... .......... .......... .......... .......... 94% 266M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69800K .......... .......... .......... .......... .......... 94% 288M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69850K .......... .......... .......... .......... .......... 95% 313M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69900K .......... .......... .......... .......... .......... 95% 294M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 69950K .......... .......... .......... .......... .......... 95% 237M 0s 2019-11-27T15:24:32.559 INFO:teuthology.orchestra.run.smithi156.stderr: 70000K .......... .......... .......... .......... .......... 95% 296M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70050K .......... .......... .......... .......... .......... 95% 281M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70100K .......... .......... .......... .......... .......... 95% 279M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70150K .......... .......... .......... .......... .......... 95% 262M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70200K .......... .......... .......... .......... .......... 95% 287M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70250K .......... .......... .......... .......... .......... 95% 297M 0s 2019-11-27T15:24:32.560 INFO:teuthology.orchestra.run.smithi156.stderr: 70300K .......... .......... .......... .......... .......... 95% 293M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70350K .......... .......... .......... .......... .......... 95% 252M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70400K .......... .......... .......... .......... .......... 95% 267M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70450K .......... .......... .......... .......... .......... 95% 301M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70500K .......... .......... .......... .......... .......... 95% 280M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70550K .......... .......... .......... .......... .......... 95% 251M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70600K .......... .......... .......... .......... .......... 96% 287M 0s 2019-11-27T15:24:32.561 INFO:teuthology.orchestra.run.smithi156.stderr: 70650K .......... .......... .......... .......... .......... 96% 298M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70700K .......... .......... .......... .......... .......... 96% 268M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70750K .......... .......... .......... .......... .......... 96% 243M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70800K .......... .......... .......... .......... .......... 96% 295M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70850K .......... .......... .......... .......... .......... 96% 228M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70900K .......... .......... .......... .......... .......... 96% 292M 0s 2019-11-27T15:24:32.562 INFO:teuthology.orchestra.run.smithi156.stderr: 70950K .......... .......... .......... .......... .......... 96% 264M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71000K .......... .......... .......... .......... .......... 96% 283M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71050K .......... .......... .......... .......... .......... 96% 308M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71100K .......... .......... .......... .......... .......... 96% 298M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71150K .......... .......... .......... .......... .......... 96% 249M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71200K .......... .......... .......... .......... .......... 96% 285M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71250K .......... .......... .......... .......... .......... 96% 282M 0s 2019-11-27T15:24:32.563 INFO:teuthology.orchestra.run.smithi156.stderr: 71300K .......... .......... .......... .......... .......... 96% 290M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71350K .......... .......... .......... .......... .......... 97% 260M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71400K .......... .......... .......... .......... .......... 97% 306M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71450K .......... .......... .......... .......... .......... 97% 303M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71500K .......... .......... .......... .......... .......... 97% 293M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71550K .......... .......... .......... .......... .......... 97% 239M 0s 2019-11-27T15:24:32.564 INFO:teuthology.orchestra.run.smithi156.stderr: 71600K .......... .......... .......... .......... .......... 97% 295M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71650K .......... .......... .......... .......... .......... 97% 287M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71700K .......... .......... .......... .......... .......... 97% 294M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71750K .......... .......... .......... .......... .......... 97% 268M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71800K .......... .......... .......... .......... .......... 97% 282M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71850K .......... .......... .......... .......... .......... 97% 290M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71900K .......... .......... .......... .......... .......... 97% 284M 0s 2019-11-27T15:24:32.565 INFO:teuthology.orchestra.run.smithi156.stderr: 71950K .......... .......... .......... .......... .......... 97% 227M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72000K .......... .......... .......... .......... .......... 97% 237M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72050K .......... .......... .......... .......... .......... 98% 278M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72100K .......... .......... .......... .......... .......... 98% 297M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72150K .......... .......... .......... .......... .......... 98% 261M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72200K .......... .......... .......... .......... .......... 98% 299M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72250K .......... .......... .......... .......... .......... 98% 294M 0s 2019-11-27T15:24:32.566 INFO:teuthology.orchestra.run.smithi156.stderr: 72300K .......... .......... .......... .......... .......... 98% 287M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72350K .......... .......... .......... .......... .......... 98% 235M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72400K .......... .......... .......... .......... .......... 98% 303M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72450K .......... .......... .......... .......... .......... 98% 291M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72500K .......... .......... .......... .......... .......... 98% 303M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72550K .......... .......... .......... .......... .......... 98% 275M 0s 2019-11-27T15:24:32.567 INFO:teuthology.orchestra.run.smithi156.stderr: 72600K .......... .......... .......... .......... .......... 98% 308M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72650K .......... .......... .......... .......... .......... 98% 293M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72700K .......... .......... .......... .......... .......... 98% 291M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72750K .......... .......... .......... .......... .......... 98% 253M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72800K .......... .......... .......... .......... .......... 99% 305M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72850K .......... .......... .......... .......... .......... 99% 306M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72900K .......... .......... .......... .......... .......... 99% 309M 0s 2019-11-27T15:24:32.568 INFO:teuthology.orchestra.run.smithi156.stderr: 72950K .......... .......... .......... .......... .......... 99% 273M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73000K .......... .......... .......... .......... .......... 99% 298M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73050K .......... .......... .......... .......... .......... 99% 302M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73100K .......... .......... .......... .......... .......... 99% 282M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73150K .......... .......... .......... .......... .......... 99% 252M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73200K .......... .......... .......... .......... .......... 99% 307M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73250K .......... .......... .......... .......... .......... 99% 295M 0s 2019-11-27T15:24:32.569 INFO:teuthology.orchestra.run.smithi156.stderr: 73300K .......... .......... .......... .......... .......... 99% 308M 0s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 73350K .......... .......... .......... .......... .......... 99% 265M 0s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 73400K .......... .......... .......... .......... .......... 99% 301M 0s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 73450K .......... .......... .......... .......... .......... 99% 312M 0s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 73500K .......... .......... .......... .......... .......... 99% 301M 0s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 73550K ........ 100% 217M=0.3s 2019-11-27T15:24:32.570 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27 15:24:31 (229 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:Archive: gradle-4.7-bin.zip 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-27T15:24:32.571 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-27T15:24:32.572 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-27T15:24:32.573 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-27T15:24:32.574 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-27T15:24:32.575 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-27T15:24:32.576 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-27T15:24:32.577 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-27T15:24:32.578 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-27T15:24:32.579 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-27T15:24:32.580 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-27T15:24:32.581 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-27T15:24:32.582 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-27T15:24:32.583 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-27T15:24:32.584 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-27T15:24:32.585 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-27T15:24:32.586 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-27T15:24:32.587 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-27T15:24:32.588 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-27T15:24:32.589 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-27T15:24:32.590 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-27T15:24:32.591 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-27T15:24:32.592 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-27T15:24:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-27T15:24:32.594 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-27T15:24:32.595 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-27T15:24:32.596 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-27T15:24:32.597 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-27T15:24:32.598 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-27T15:24:32.599 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-27T15:24:32.600 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-27T15:24:32.601 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-27T15:24:32.602 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-27T15:24:32.603 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-27T15:24:32.604 INFO:teuthology.orchestra.run.smithi156.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-27T15:24:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-27T15:24:33.066 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:Welcome to Gradle 4.7! 2019-11-27T15:24:33.067 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:Here are the highlights of this release: 2019-11-27T15:24:33.068 INFO:teuthology.orchestra.run.smithi156.stdout: - Incremental annotation processing 2019-11-27T15:24:33.068 INFO:teuthology.orchestra.run.smithi156.stdout: - JDK 10 support 2019-11-27T15:24:33.068 INFO:teuthology.orchestra.run.smithi156.stdout: - Grouped non-interactive console logs 2019-11-27T15:24:33.068 INFO:teuthology.orchestra.run.smithi156.stdout: - Failed tests are re-run first for quicker feedback 2019-11-27T15:24:33.068 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-27T15:24:33.069 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.443 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:------------------------------------------------------------ 2019-11-27T15:24:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:Gradle 4.7 2019-11-27T15:24:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:------------------------------------------------------------ 2019-11-27T15:24:33.444 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-27T15:24:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-27T15:24:33.450 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:Groovy: 2.4.12 2019-11-27T15:24:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-27T15:24:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-27T15:24:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-27T15:24:33.451 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:33.451 INFO:teuthology.orchestra.run.smithi156:> sudo keytool -import -alias smithi156.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2019-11-27T15:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:Certificate was added to keystore 2019-11-27T15:24:33.899 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-27T15:24:33.900 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-27T15:24:33.900 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi156.front.sepia.ceph.com 2019-11-27T15:24:33.900 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-27T15:24:33.900 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi003.front.sepia.ceph.com 2019-11-27T15:24:33.900 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-27T15:24:34.299 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-27T15:24:34.299 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-27T15:24:34.300 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'EMWGNZLOEHXZOVDNSPJI', 's3dir': 'folder', 'endpoint': 'smithi156.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': 'kGB3HLqcD7s8F2i5fqdDnny3UWQUFeDhe93bD4Wh16Rdz/zJIbptpw==', 'host': 'smithi156.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-27T15:24:34.300 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-27T15:24:34.300 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'EMWGNZLOEHXZOVDNSPJI', '--secret', 'kGB3HLqcD7s8F2i5fqdDnny3UWQUFeDhe93bD4Wh16Rdz/zJIbptpw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-27T15:24:34.301 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key EMWGNZLOEHXZOVDNSPJI --secret kGB3HLqcD7s8F2i5fqdDnny3UWQUFeDhe93bD4Wh16Rdz/zJIbptpw== --email tester.client.0_test@test.test --cluster ceph 2019-11-27T15:24:34.425 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.431+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.447 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.453+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.447 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.453+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.462+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.462+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.468+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.468+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.470 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.475+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.738+0000 7f4a41e5bec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:24:34.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.738+0000 7f4a41e5bec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:24:34.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.738+0000 7f4a41e5bec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:24:34.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.738+0000 7f4a41e5bec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:24:34.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.738+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.749+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.749+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.770+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.770+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.782+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:34.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.782+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.799+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:34.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.799+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.807+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.807+0000 7f4a41e5bec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:24:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.807+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.813+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.813+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.823+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:34.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.823+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.838+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:34.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.838+0000 7f4a41e5bec0 20 zonegroup default 2019-11-27T15:24:34.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.838+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.845+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.840 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.845+0000 7f4a41e5bec0 10 Cannot find current period zone using local zone 2019-11-27T15:24:34.840 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.845+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.847 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.852+0000 7f4a41e5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:34.847 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.852+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.861+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:34.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.861+0000 7f4a41e5bec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:34.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.881+0000 7f4a41e5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:34.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.881+0000 7f4a41e5bec0 20 zone default found 2019-11-27T15:24:34.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.881+0000 7f4a41e5bec0 20 started sync module instance, tier type = 2019-11-27T15:24:34.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:34.881+0000 7f4a41e5bec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:24:35.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=0 2019-11-27T15:24:35.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=1 2019-11-27T15:24:35.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=2 2019-11-27T15:24:35.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=3 2019-11-27T15:24:35.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=4 2019-11-27T15:24:35.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.301+0000 7f4a41e5bec0 20 add_watcher() i=5 2019-11-27T15:24:35.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.346+0000 7f4a41e5bec0 20 add_watcher() i=6 2019-11-27T15:24:35.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.354+0000 7f4a41e5bec0 20 add_watcher() i=7 2019-11-27T15:24:35.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.354+0000 7f4a41e5bec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:24:35.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.354+0000 7f49fffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:24:35.350 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.355+0000 7f4a2f088700 0 -- >> v2:172.21.15.156:3300/0 conn(0x55f3d673a4b0 msgr2=0x55f3d673c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T15:24:35.388 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:35.394+0000 7f4a2f889700 0 -- 172.21.15.156:0/3980987786 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7f4978017570 msgr2=0x7f4978019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:24:36.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.832+0000 7f49727fc700 20 reqs_thread_entry: start 2019-11-27T15:24:36.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.833+0000 7f495ffff700 20 reqs_thread_entry: start 2019-11-27T15:24:36.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.833+0000 7f4a41e5bec0 20 init_complete bucket index max shards: 0 2019-11-27T15:24:36.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.833+0000 7f495e7fc700 20 reqs_thread_entry: start 2019-11-27T15:24:36.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.833+0000 7f4a41e5bec0 20 get_system_obj_state: rctx=0x7fff5e957978 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55f3d67badf0 s->prefetch_data=0 2019-11-27T15:24:36.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.833+0000 7f4a41e5bec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-27T15:24:36.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.844+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-27T15:24:36.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.844+0000 7f4a41e5bec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T15:24:36.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.844+0000 7f4a41e5bec0 20 get_system_obj_state: rctx=0x7fff5e957988 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55f3d67bcb80 s->prefetch_data=0 2019-11-27T15:24:36.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.844+0000 7f4a41e5bec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-27T15:24:36.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.853+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-27T15:24:36.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.853+0000 7f4a41e5bec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T15:24:36.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.853+0000 7f4a41e5bec0 20 get_system_obj_state: rctx=0x7fff5e957988 obj=default.rgw.meta:users.keys:EMWGNZLOEHXZOVDNSPJI state=0x55f3d67bcb80 s->prefetch_data=0 2019-11-27T15:24:36.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.853+0000 7f4a41e5bec0 10 cache get: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI : miss 2019-11-27T15:24:36.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.870+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI info.flags=0x0 2019-11-27T15:24:36.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.870+0000 7f4a41e5bec0 10 adding default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI to cache LRU end 2019-11-27T15:24:36.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.870+0000 7f4a41e5bec0 20 get_system_obj_state: rctx=0x7fff5e957598 obj=default.rgw.meta:users.keys:EMWGNZLOEHXZOVDNSPJI state=0x55f3d67bcb80 s->prefetch_data=0 2019-11-27T15:24:36.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.870+0000 7f4a41e5bec0 10 cache get: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI : type miss (requested=0x6, cached=0x0) 2019-11-27T15:24:36.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.886+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI info.flags=0x0 2019-11-27T15:24:36.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.886+0000 7f4a41e5bec0 10 moving default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI to cache LRU end 2019-11-27T15:24:36.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.886+0000 7f4a41e5bec0 20 get_system_obj_state: rctx=0x7fff5e957718 obj=default.rgw.meta:users.keys:EMWGNZLOEHXZOVDNSPJI state=0x55f3d67bcb80 s->prefetch_data=0 2019-11-27T15:24:36.881 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.886+0000 7f4a41e5bec0 10 cache get: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI : type miss (requested=0x6, cached=0x0) 2019-11-27T15:24:36.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.900+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI info.flags=0x0 2019-11-27T15:24:36.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.900+0000 7f4a41e5bec0 10 moving default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI to cache LRU end 2019-11-27T15:24:36.965 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.970+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-27T15:24:36.965 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.970+0000 7f4a41e5bec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T15:24:36.965 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.970+0000 7f4a41e5bec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-27T15:24:36.982 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.988+0000 7f4a14ff9700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94505763250896 notifier 4487 bl.length()=632 2019-11-27T15:24:36.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.988+0000 7f4a14ff9700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-27T15:24:36.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:36.988+0000 7f4a14ff9700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-27T15:24:37.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.212+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-27T15:24:37.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.212+0000 7f4a41e5bec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T15:24:37.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.212+0000 7f4a41e5bec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-27T15:24:37.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.235+0000 7f4a14ff9700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94505763230240 notifier 4487 bl.length()=200 2019-11-27T15:24:37.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.235+0000 7f4a14ff9700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-27T15:24:37.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.235+0000 7f4a14ff9700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-27T15:24:37.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.757+0000 7f4a41e5bec0 10 cache put: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI info.flags=0x7 2019-11-27T15:24:37.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.757+0000 7f4a41e5bec0 10 moving default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI to cache LRU end 2019-11-27T15:24:37.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.757+0000 7f4a41e5bec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=189 2019-11-27T15:24:37.764 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.770+0000 7f4a14ff9700 10 RGWWatcher::handle_notify() notify_id 566935683079 cookie 94505763245296 notifier 4487 bl.length()=189 2019-11-27T15:24:37.764 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.770+0000 7f4a14ff9700 10 cache put: name=default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI info.flags=0x7 2019-11-27T15:24:37.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.770+0000 7f4a14ff9700 10 moving default.rgw.meta+users.keys+EMWGNZLOEHXZOVDNSPJI to cache LRU end 2019-11-27T15:24:37.838 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T15:24:37.838 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "tester.client.0", 2019-11-27T15:24:37.838 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Ms. tester.client.0", 2019-11-27T15:24:37.838 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "tester.client.0_test@test.test", 2019-11-27T15:24:37.838 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "tester.client.0", 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "EMWGNZLOEHXZOVDNSPJI", 2019-11-27T15:24:37.839 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "kGB3HLqcD7s8F2i5fqdDnny3UWQUFeDhe93bD4Wh16Rdz/zJIbptpw==" 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T15:24:37.840 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:24:37.841 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T15:24:37.842 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T15:24:37.843 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T15:24:37.843 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T15:24:37.843 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T15:24:37.843 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:24:37.918 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.923+0000 7f4a41e5bec0 20 remove_watcher() i=0 2019-11-27T15:24:37.918 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.923+0000 7f4a41e5bec0 2 removed watcher, disabling cache 2019-11-27T15:24:37.970 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:37.976+0000 7f4a41e5bec0 20 remove_watcher() i=1 2019-11-27T15:24:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.025+0000 7f4a41e5bec0 20 remove_watcher() i=2 2019-11-27T15:24:38.099 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.105+0000 7f4a41e5bec0 20 remove_watcher() i=3 2019-11-27T15:24:38.149 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.154+0000 7f4a41e5bec0 20 remove_watcher() i=4 2019-11-27T15:24:38.197 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.203+0000 7f4a41e5bec0 20 remove_watcher() i=5 2019-11-27T15:24:38.239 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.244+0000 7f4a41e5bec0 20 remove_watcher() i=6 2019-11-27T15:24:38.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.291+0000 7f4a41e5bec0 20 remove_watcher() i=7 2019-11-27T15:24:38.297 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-27T15:24:38.355 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-27T15:24:38.356 INFO:teuthology.orchestra.run.smithi156:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-27T15:24:38.433 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T15:24:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.607+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.631+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.631+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.641+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.641+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.647+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.642 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.647+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.648 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.653+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:38.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.895+0000 7fc5e189aec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:24:38.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.895+0000 7fc5e189aec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:24:38.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.895+0000 7fc5e189aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:24:38.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.895+0000 7fc5e189aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:24:38.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.895+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.907+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.907+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.926+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:38.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.926+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.938+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:38.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.938+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.957+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.957+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.964+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.964+0000 7fc5e189aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:24:38.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.964+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.969+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.969+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.978+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:38.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.978+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.988 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.994+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:38.988 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.994+0000 7fc5e189aec0 20 zonegroup default 2019-11-27T15:24:38.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:38.994+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.002+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.002+0000 7fc5e189aec0 10 Cannot find current period zone using local zone 2019-11-27T15:24:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.002+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:39.002 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.008+0000 7fc5e189aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.008+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.018+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.018+0000 7fc5e189aec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.037+0000 7fc5e189aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.037+0000 7fc5e189aec0 20 zone default found 2019-11-27T15:24:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.037+0000 7fc5e189aec0 20 started sync module instance, tier type = 2019-11-27T15:24:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.037+0000 7fc5e189aec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:24:39.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=0 2019-11-27T15:24:39.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=1 2019-11-27T15:24:39.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=2 2019-11-27T15:24:39.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=3 2019-11-27T15:24:39.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=4 2019-11-27T15:24:39.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.780+0000 7fc5e189aec0 20 add_watcher() i=5 2019-11-27T15:24:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.793+0000 7fc5e189aec0 20 add_watcher() i=6 2019-11-27T15:24:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.838+0000 7fc5e189aec0 20 add_watcher() i=7 2019-11-27T15:24:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.838+0000 7fc5e189aec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:24:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.839+0000 7fc59f7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:24:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.844+0000 7fc5ceac7700 0 -- 172.21.15.156:0/1342702333 >> v1:172.21.15.3:6789/0 conn(0x55e295cb15c0 legacy=0x55e295cb7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T15:24:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:39.898+0000 7fc5ceac7700 0 -- 172.21.15.156:0/1425955897 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7fc510017570 msgr2=0x7fc510019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:24:41.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.659+0000 7fc50dffb700 20 reqs_thread_entry: start 2019-11-27T15:24:41.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.660+0000 7fc4ff7fe700 20 reqs_thread_entry: start 2019-11-27T15:24:41.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.660+0000 7fc5e189aec0 20 init_complete bucket index max shards: 0 2019-11-27T15:24:41.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.660+0000 7fc4fdffb700 20 reqs_thread_entry: start 2019-11-27T15:24:41.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.660+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T15:24:41.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.727+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:41.748 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.753+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.789+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.789+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.84', time=2019-11-27T17:24:14.949411+0000, chain.objs.size()=3 2019-11-27T15:24:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.789+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.R15DJ3rwmP5-KDhFwBIvDnGlLrlj6PL_0 2019-11-27T15:24:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.789+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.R15DJ3rwmP5-KDhFwBIvDnGlLrlj6PL_1 2019-11-27T15:24:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.789+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.R15DJ3rwmP5-KDhFwBIvDnGlLrlj6PL_2 2019-11-27T15:24:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:41.962+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.133+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T15:24:42.179 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.184+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:42.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.204+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:42.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.218+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:42.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.249+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T15:24:42.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.288+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:42.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.303+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:42.322 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.328+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:42.322 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.328+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.112', time=2019-11-27T17:24:06.856946+0000, chain.objs.size()=2 2019-11-27T15:24:42.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.328+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.f4S0chbslS0KH8aVa8Ovy1m-HRd7vZW_0 2019-11-27T15:24:42.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.328+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.f4S0chbslS0KH8aVa8Ovy1m-HRd7vZW_1 2019-11-27T15:24:42.382 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.389+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:42.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.574+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T15:24:42.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.636+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:42.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.660+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.707+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.707+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_HAJzMPuL3QZFAmY6B_rVInpG6KxukTz', time=2019-11-27T17:24:10.226808+0000, chain.objs.size()=3 2019-11-27T15:24:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.707+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.Hkt3KiSnapop_azJ8dzYzkZtJ8kDpHI_0 2019-11-27T15:24:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.707+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.Hkt3KiSnapop_azJ8dzYzkZtJ8kDpHI_1 2019-11-27T15:24:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.707+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.Hkt3KiSnapop_azJ8dzYzkZtJ8kDpHI_2 2019-11-27T15:24:42.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:42.881+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:43.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.107+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T15:24:43.152 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.158+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.175+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.184+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.219+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T15:24:43.255 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.261+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.277+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:43.279 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.286+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.330+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T15:24:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.412+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.445+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.463+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.463+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_u37XrsE3XrCw_nYIoj56vvi5H1IK7nq', time=2019-11-27T17:24:10.581359+0000, chain.objs.size()=2 2019-11-27T15:24:43.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.464+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.ayIzaYSzZapanxzcytibBhYTl7IJxwM_1 2019-11-27T15:24:43.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.464+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.ayIzaYSzZapanxzcytibBhYTl7IJxwM_2 2019-11-27T15:24:43.603 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.609+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:43.723 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.728+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T15:24:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.794+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:43.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.812+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:43.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.823+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:43.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.823+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.109', time=2019-11-27T17:24:06.049657+0000, chain.objs.size()=2 2019-11-27T15:24:43.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.823+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.GCCC0M7IigsbdqEtCiv7kg_0B8xREK__0 2019-11-27T15:24:43.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.823+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.GCCC0M7IigsbdqEtCiv7kg_0B8xREK__1 2019-11-27T15:24:43.900 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.905+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:43.995+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T15:24:44.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.057+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:44.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.086+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:44.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:44.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.55', time=2019-11-27T17:24:03.074567+0000, chain.objs.size()=7 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__multipart_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.1 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__shadow_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.1_1 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__multipart_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.2 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__shadow_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.2_1 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__multipart_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.3 2019-11-27T15:24:44.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__shadow_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.3_1 2019-11-27T15:24:44.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.4__multipart_foo.2~iqDbhKPfJ5sMMVs72nsV3_p6qYnwHwl.4 2019-11-27T15:24:44.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.119', time=2019-11-27T17:24:08.608934+0000, chain.objs.size()=1 2019-11-27T15:24:44.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.128+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.X5qyqfoOiQwTCgc3FCjkgBR_hs-WKOq_1 2019-11-27T15:24:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.357+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:44.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.451+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T15:24:44.495 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.500+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:44.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.516+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:44.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.542+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:44.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.542+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_9ZBYajnSFiOaVI9FoBvHwK-4m4RNTxP', time=2019-11-27T17:24:07.066719+0000, chain.objs.size()=2 2019-11-27T15:24:44.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.542+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.1hPtZ2X1DZDJ1kNRN7Fb2al29px5_fS_0 2019-11-27T15:24:44.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.542+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.1hPtZ2X1DZDJ1kNRN7Fb2al29px5_fS_1 2019-11-27T15:24:44.758 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.763+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:44.917+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T15:24:44.994 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.000+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:45.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.030+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:45.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.061+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:45.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.061+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_IK8-NVcVa3JHEwtT-zxuGz_aZLQlqO5', time=2019-11-27T17:24:11.036239+0000, chain.objs.size()=3 2019-11-27T15:24:45.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.061+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.HSo206kpE6Pq2Q2GVUmDD2dhG3rk5If_0 2019-11-27T15:24:45.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.061+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.HSo206kpE6Pq2Q2GVUmDD2dhG3rk5If_1 2019-11-27T15:24:45.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.062+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.HSo206kpE6Pq2Q2GVUmDD2dhG3rk5If_2 2019-11-27T15:24:45.216 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.222+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:45.342 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.347+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T15:24:45.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.439+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:45.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.467+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:45.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.509+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:45.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.509+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_3hzzyuy5VMUYLn1DGrbVNtoSDkF-nOu', time=2019-11-27T17:24:06.273442+0000, chain.objs.size()=2 2019-11-27T15:24:45.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.510+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.YF5_1IQgDDCDeVsStHNEAVR3fATjmWR_0 2019-11-27T15:24:45.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.510+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.YF5_1IQgDDCDeVsStHNEAVR3fATjmWR_1 2019-11-27T15:24:45.695 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.700+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:45.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.853+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T15:24:45.919 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.925+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:45.937 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.942+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.982+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.982+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.211', time=2019-11-27T17:24:13.936018+0000, chain.objs.size()=3 2019-11-27T15:24:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.982+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-STANDARD.2~nI-Zt7yjQNAXNyfgw5XZq5ujdQjEkXA.1 2019-11-27T15:24:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.982+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-STANDARD.2~nI-Zt7yjQNAXNyfgw5XZq5ujdQjEkXA.2 2019-11-27T15:24:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:45.982+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-STANDARD.2~nI-Zt7yjQNAXNyfgw5XZq5ujdQjEkXA.3 2019-11-27T15:24:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.066+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:46.172 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.178+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T15:24:46.221 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.226+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:46.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.248+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:46.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:46.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.225', time=2019-11-27T17:24:09.795660+0000, chain.objs.size()=5 2019-11-27T15:24:46.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.1 2019-11-27T15:24:46.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.1_1 2019-11-27T15:24:46.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.2 2019-11-27T15:24:46.258 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.2_1 2019-11-27T15:24:46.258 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.262+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.3 2019-11-27T15:24:46.353 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.358+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:46.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.452+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T15:24:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.505+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:46.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.524+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:46.529 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.534+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:46.578 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.583+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T15:24:46.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.620+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:46.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.635+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:46.644 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:46.644 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.71', time=2019-11-27T17:24:04.283062+0000, chain.objs.size()=4 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5__multipart_foo.2~AuJ2Dw9XXGl89qAnEvca_ZiHjygnhSY.1 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5__multipart_foo.2~AuJ2Dw9XXGl89qAnEvca_ZiHjygnhSY.2 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5__multipart_foo.2~AuJ2Dw9XXGl89qAnEvca_ZiHjygnhSY.3 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.5__multipart_foo.2~AuJ2Dw9XXGl89qAnEvca_ZiHjygnhSY.4 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_BT0tz3L1Ixm94z_M7DIl4vd45RBUHGJ', time=2019-11-27T17:24:07.704646+0000, chain.objs.size()=1 2019-11-27T15:24:46.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.650+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.rF8YiFQEKQjGgyxUG0eDuY5dPwR91QH_1 2019-11-27T15:24:46.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.801+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.875+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T15:24:46.963 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:46.968+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:46.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.002+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.025+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.025+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.85', time=2019-11-27T17:24:15.188514+0000, chain.objs.size()=3 2019-11-27T15:24:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.025+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.lHV2a-E3pQRJ-V_IGuyoRfC9_uZJIfC_0 2019-11-27T15:24:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.025+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.lHV2a-E3pQRJ-V_IGuyoRfC9_uZJIfC_1 2019-11-27T15:24:47.021 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.025+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.6__shadow_.lHV2a-E3pQRJ-V_IGuyoRfC9_uZJIfC_2 2019-11-27T15:24:47.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.274+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:47.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.421+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T15:24:47.475 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.480+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:47.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.504+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:47.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:47.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_Wi10UfDKm1oaxX4DR7r_8Sayoog3qp0', time=2019-11-27T17:24:08.219121+0000, chain.objs.size()=2 2019-11-27T15:24:47.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.uG7uR_uIrIKq4R-6D6QUscLyJwQwz2g_0 2019-11-27T15:24:47.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.uG7uR_uIrIKq4R-6D6QUscLyJwQwz2g_1 2019-11-27T15:24:47.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_cLkjlQEh7xJPKFyxPOiNP-MzuAta8B_', time=2019-11-27T17:24:08.373872+0000, chain.objs.size()=2 2019-11-27T15:24:47.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.WrlcZ_vifRmlCrZLEKq3H7aMqqoafeN_0 2019-11-27T15:24:47.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.520+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.WrlcZ_vifRmlCrZLEKq3H7aMqqoafeN_1 2019-11-27T15:24:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.735+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:47.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.876+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T15:24:47.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.944+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:47.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:47.965+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:47.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.003+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:47.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.003+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_KBN0tqxHbhagXoRGgL8rtNR-o-mJ1BU', time=2019-11-27T17:24:12.063705+0000, chain.objs.size()=1 2019-11-27T15:24:47.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.003+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.LkQujZ5WHi4hr56higeqHnbBR3CWq2V_0 2019-11-27T15:24:48.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.059+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:48.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.186+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T15:24:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.235+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.274+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:48.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.291+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:48.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.291+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_sW78xOXPF_an4YiUbU2HMaVCD_pYnoR', time=2019-11-27T17:24:06.663185+0000, chain.objs.size()=1 2019-11-27T15:24:48.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.291+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.RU99yM-c873u0K5kgYyrUHhFQg6iQ3Y_1 2019-11-27T15:24:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.342+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:48.422 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.427+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T15:24:48.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.478+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.495+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:48.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:48.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_hzFuswlKtRBIjGWLr6OPxAIdxPn4coC', time=2019-11-27T17:24:11.607455+0000, chain.objs.size()=2 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.-qeWV3SJKM06Jz_9PEQ8m0hvSqtPAaU_1 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.-qeWV3SJKM06Jz_9PEQ8m0hvSqtPAaU_2 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.243', time=2019-11-27T17:24:11.820734+0000, chain.objs.size()=3 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.1 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.2 2019-11-27T15:24:48.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.508+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.3 2019-11-27T15:24:48.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.691+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:48.798 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.803+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T15:24:48.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.868+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:48.887 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.892+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:48.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.911+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:48.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.911+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.20', time=2019-11-27T17:24:00.350659+0000, chain.objs.size()=4 2019-11-27T15:24:48.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.911+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2__multipart_foo.2~IIapELepY_s5ZoOAqJ3a75KhI555SeM.1 2019-11-27T15:24:48.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.912+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2__multipart_foo.2~IIapELepY_s5ZoOAqJ3a75KhI555SeM.2 2019-11-27T15:24:48.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.912+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2__multipart_foo.2~IIapELepY_s5ZoOAqJ3a75KhI555SeM.3 2019-11-27T15:24:48.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:48.912+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.2__multipart_foo.2~IIapELepY_s5ZoOAqJ3a75KhI555SeM.4 2019-11-27T15:24:49.002 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.008+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:49.182 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.187+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T15:24:49.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.246+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:49.259 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.264+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:49.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:49.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.204', time=2019-11-27T17:24:13.768758+0000, chain.objs.size()=5 2019-11-27T15:24:49.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-LUKEWARM.2~nQdEZe4NXICmsnqyTSHGzGtju782WEW.1 2019-11-27T15:24:49.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__shadow_foo-LUKEWARM.2~nQdEZe4NXICmsnqyTSHGzGtju782WEW.1_1 2019-11-27T15:24:49.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-LUKEWARM.2~nQdEZe4NXICmsnqyTSHGzGtju782WEW.2 2019-11-27T15:24:49.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__shadow_foo-LUKEWARM.2~nQdEZe4NXICmsnqyTSHGzGtju782WEW.2_1 2019-11-27T15:24:49.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.282+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-LUKEWARM.2~nQdEZe4NXICmsnqyTSHGzGtju782WEW.3 2019-11-27T15:24:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.479+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.615+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T15:24:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.695+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.724+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.738+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.738+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.108', time=2019-11-27T17:24:05.888035+0000, chain.objs.size()=2 2019-11-27T15:24:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.738+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.GCCC0M7IigsbdqEtCiv7kg_0B8xREK__0 2019-11-27T15:24:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.738+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.GCCC0M7IigsbdqEtCiv7kg_0B8xREK__1 2019-11-27T15:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:49.919+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.014+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T15:24:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.049+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.065+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T15:24:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.226', time=2019-11-27T17:24:10.005648+0000, chain.objs.size()=5 2019-11-27T15:24:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.1 2019-11-27T15:24:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.1_1 2019-11-27T15:24:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.2 2019-11-27T15:24:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.2_1 2019-11-27T15:24:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.076+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-FROZEN.2~-H4WeQr3vw44wkJp1aVyru_4UlgjTBD.3 2019-11-27T15:24:50.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.316+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:50.389 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.394+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T15:24:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.434+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.451+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.460+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.489+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T15:24:50.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.546+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.562+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:50.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.574+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.630+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T15:24:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.709+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.748+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:50.763 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.768+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.827+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T15:24:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.872+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.892+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:50.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.40', time=2019-11-27T17:24:01.572377+0000, chain.objs.size()=4 2019-11-27T15:24:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3__multipart_foo.2~qEaiasA6Btfwixh7wPVi4lNgnNRnqL6.1 2019-11-27T15:24:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3__multipart_foo.2~qEaiasA6Btfwixh7wPVi4lNgnNRnqL6.2 2019-11-27T15:24:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3__multipart_foo.2~qEaiasA6Btfwixh7wPVi4lNgnNRnqL6.3 2019-11-27T15:24:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.3__multipart_foo.2~qEaiasA6Btfwixh7wPVi4lNgnNRnqL6.4 2019-11-27T15:24:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='_08PLU4wXJiyXTTk9ksa25oJcLF26atN', time=2019-11-27T17:24:12.262633+0000, chain.objs.size()=1 2019-11-27T15:24:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:50.907+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_.g98dxKzcaaLqyVK1maRp3Seh9ViOVhm_0 2019-11-27T15:24:51.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.010+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:51.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.099+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T15:24:51.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.194+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.225+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.114', time=2019-11-27T17:24:07.322362+0000, chain.objs.size()=2 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.f4S0chbslS0KH8aVa8Ovy1m-HRd7vZW_0 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.f4S0chbslS0KH8aVa8Ovy1m-HRd7vZW_1 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.116', time=2019-11-27T17:24:08.041863+0000, chain.objs.size()=1 2019-11-27T15:24:51.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.247+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.7__shadow_.X5qyqfoOiQwTCgc3FCjkgBR_hs-WKOq_1 2019-11-27T15:24:51.425 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.430+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.555+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T15:24:51.617 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.622+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:51.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.646+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.234', time=2019-11-27T17:24:10.793438+0000, chain.objs.size()=5 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.1 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.1_1 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.2 2019-11-27T15:24:51.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.2_1 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.3 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.236', time=2019-11-27T17:24:11.253139+0000, chain.objs.size()=5 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.1 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.1_1 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.2 2019-11-27T15:24:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__shadow_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.2_1 2019-11-27T15:24:51.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.666+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-LUKEWARM.2~ba6jav0Okhu6i4njbFeTxRaqdv5Ykur.3 2019-11-27T15:24:51.929 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:51.934+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:52.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.008+0000 7fc5e189aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T15:24:52.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.044+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:52.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.060+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:52.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.246', time=2019-11-27T17:24:12.380099+0000, chain.objs.size()=3 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.1 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.2 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.9__multipart_foo-STANDARD.2~cYU1LUlh0OhRVdUrSeHHEkRC2fdNNS0.3 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.197', time=2019-11-27T17:24:13.582465+0000, chain.objs.size()=5 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-FROZEN.2~SXbZWlIlVMhLX8-fkz5o61tFY6jnI_Y.1 2019-11-27T15:24:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__shadow_foo-FROZEN.2~SXbZWlIlVMhLX8-fkz5o61tFY6jnI_Y.1_1 2019-11-27T15:24:52.070 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-FROZEN.2~SXbZWlIlVMhLX8-fkz5o61tFY6jnI_Y.2 2019-11-27T15:24:52.070 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__shadow_foo-FROZEN.2~SXbZWlIlVMhLX8-fkz5o61tFY6jnI_Y.2_1 2019-11-27T15:24:52.070 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.073+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.8__multipart_foo-FROZEN.2~SXbZWlIlVMhLX8-fkz5o61tFY6jnI_Y.3 2019-11-27T15:24:52.290 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.295+0000 7fc5e189aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T15:24:52.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.463+0000 7fc5e189aec0 20 remove_watcher() i=0 2019-11-27T15:24:52.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.463+0000 7fc5e189aec0 2 removed watcher, disabling cache 2019-11-27T15:24:52.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.503+0000 7fc5e189aec0 20 remove_watcher() i=1 2019-11-27T15:24:52.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.543+0000 7fc5e189aec0 20 remove_watcher() i=2 2019-11-27T15:24:52.613 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.618+0000 7fc5e189aec0 20 remove_watcher() i=3 2019-11-27T15:24:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.674+0000 7fc5e189aec0 20 remove_watcher() i=4 2019-11-27T15:24:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.727+0000 7fc5e189aec0 20 remove_watcher() i=5 2019-11-27T15:24:52.783 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.788+0000 7fc5e189aec0 20 remove_watcher() i=6 2019-11-27T15:24:52.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:52.858+0000 7fc5e189aec0 20 remove_watcher() i=7 2019-11-27T15:24:52.862 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T15:24:53.018 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.023+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.045 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.050+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.046 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.050+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.060+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.060+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.065+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.065+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.072+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:53.302 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.307+0000 7fb843e62ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T15:24:53.302 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.307+0000 7fb843e62ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T15:24:53.302 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.307+0000 7fb843e62ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T15:24:53.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.307+0000 7fb843e62ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T15:24:53.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.307+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.316+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:53.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.317+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.331+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:53.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.331+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.342+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.342+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.352+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.353+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.359+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.359+0000 7fb843e62ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T15:24:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.359+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.360 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.365+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.366+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.373+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:53.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.373+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.383+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T15:24:53.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.383+0000 7fb843e62ec0 20 zonegroup default 2019-11-27T15:24:53.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.383+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.390+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.390+0000 7fb843e62ec0 10 Cannot find current period zone using local zone 2019-11-27T15:24:53.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.390+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.399+0000 7fb843e62ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T15:24:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.399+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.401 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.406+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T15:24:53.401 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.406+0000 7fb843e62ec0 20 rados->read ofs=0 len=0 2019-11-27T15:24:53.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.417+0000 7fb843e62ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T15:24:53.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.417+0000 7fb843e62ec0 20 zone default found 2019-11-27T15:24:53.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.417+0000 7fb843e62ec0 20 started sync module instance, tier type = 2019-11-27T15:24:53.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.417+0000 7fb843e62ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T15:24:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.718+0000 7fb83108f700 0 -- 172.21.15.156:0/3514370137 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x55e28476bdf0 msgr2=0x55e28476e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:24:53.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=0 2019-11-27T15:24:53.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=1 2019-11-27T15:24:53.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=2 2019-11-27T15:24:53.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=3 2019-11-27T15:24:53.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=4 2019-11-27T15:24:53.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=5 2019-11-27T15:24:53.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.857+0000 7fb843e62ec0 20 add_watcher() i=6 2019-11-27T15:24:53.889 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.894+0000 7fb843e62ec0 20 add_watcher() i=7 2019-11-27T15:24:53.889 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.894+0000 7fb843e62ec0 2 all 8 watchers are set, enabling cache 2019-11-27T15:24:53.889 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.894+0000 7fb801fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T15:24:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:53.907+0000 7fb83108f700 0 -- 172.21.15.156:0/3035837725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55e284798510 msgr2=0x55e284798920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T15:24:55.322 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.325+0000 7fb773fff700 20 reqs_thread_entry: start 2019-11-27T15:24:55.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.325+0000 7fb771ffb700 20 reqs_thread_entry: start 2019-11-27T15:24:55.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.325+0000 7fb843e62ec0 20 init_complete bucket index max shards: 0 2019-11-27T15:24:55.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.325+0000 7fb75ffff700 20 reqs_thread_entry: start 2019-11-27T15:24:55.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.325+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T15:24:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.418+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.449+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:55.467 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.465+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.509+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T15:24:55.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.575+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.596+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.606+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.661+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T15:24:55.719 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.723+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.742+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:55.750 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.755+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.791 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.796+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T15:24:55.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.857+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.874+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:55.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.884+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.915 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.920+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T15:24:55.973 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.978+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:55.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:55.998+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.007+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.041 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.046+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T15:24:56.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.098+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.107 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.112+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.115 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.121+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.167+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T15:24:56.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.235+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.250+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.255 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.260+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.306+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T15:24:56.353 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.358+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.394 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.399+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.408 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.413+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.460 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.465+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T15:24:56.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.516+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.543+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.555+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.591+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T15:24:56.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.631+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.648+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.657+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.688+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T15:24:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.899+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.922 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.927+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.940+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:56.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:56.997+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T15:24:57.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.071+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.109+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.131+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.203+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T15:24:57.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.252+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.276+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.280 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.285+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.332+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T15:24:57.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.415+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.445+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.459+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.508+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T15:24:57.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.589+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.611 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.616+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.623 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.627+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.661 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.666+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T15:24:57.709 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.714+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.725 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.730+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.734 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.739+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.771+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T15:24:57.849 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.854+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.884+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:57.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.901+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:57.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:57.954+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T15:24:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.039+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.079+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:58.085 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.090+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.128 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.133+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T15:24:58.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.194+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.209 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.214+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:58.220 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.225+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.259+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T15:24:58.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.300+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.318 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.323+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:58.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.334+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.360+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T15:24:58.575 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.579+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.595 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.600+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:58.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.611+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.650+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T15:24:58.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.847+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.868+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:58.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.876+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:58.946 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:58.951+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T15:24:59.012 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.016+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.039+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.051 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.056+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.109+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T15:24:59.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.180+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.205+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.217+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.261 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.266+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T15:24:59.372 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.377+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.395 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.400+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.408 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.413+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.450 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.454+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T15:24:59.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.513+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.529+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.537+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.568+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T15:24:59.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.643+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.682+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.695 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.700+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.775+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T15:24:59.837 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.842+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.859+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:24:59.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.868+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:24:59.930 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:24:59.935+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T15:25:00.000 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.004+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.029+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:25:00.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.044+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.086+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T15:25:00.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.146+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.165+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:25:00.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.177+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.212+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T15:25:00.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.251+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.261 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.266+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:25:00.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.275+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.305+0000 7fb843e62ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T15:25:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.346+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.356 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.361+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T15:25:00.364 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.369+0000 7fb843e62ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T15:25:00.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.466+0000 7fb843e62ec0 20 remove_watcher() i=0 2019-11-27T15:25:00.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.466+0000 7fb843e62ec0 2 removed watcher, disabling cache 2019-11-27T15:25:00.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.503+0000 7fb843e62ec0 20 remove_watcher() i=1 2019-11-27T15:25:00.536 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.541+0000 7fb843e62ec0 20 remove_watcher() i=2 2019-11-27T15:25:00.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.598+0000 7fb843e62ec0 20 remove_watcher() i=3 2019-11-27T15:25:00.644 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.650+0000 7fb843e62ec0 20 remove_watcher() i=4 2019-11-27T15:25:00.694 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.699+0000 7fb843e62ec0 20 remove_watcher() i=5 2019-11-27T15:25:00.747 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.752+0000 7fb843e62ec0 20 remove_watcher() i=6 2019-11-27T15:25:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T15:25:00.810+0000 7fb843e62ec0 20 remove_watcher() i=7 2019-11-27T15:25:00.810 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-27T15:25:01.337 INFO:teuthology.orchestra.run.smithi156.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-27T15:25:04.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-27T15:25:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-27T15:25:06.039 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :clean UP-TO-DATE 2019-11-27T15:25:06.137 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-27T15:25:06.237 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-27T15:25:06.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-27T15:25:06.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-27T15:25:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-27T15:25:06.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-27T15:25:06.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-27T15:25:06.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-27T15:25:06.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-27T15:25:06.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-27T15:25:06.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-27T15:25:06.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-27T15:25:06.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-27T15:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-27T15:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-27T15:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-27T15:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-27T15:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-27T15:25:06.742 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-27T15:25:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-27T15:25:06.744 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-27T15:25:06.745 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-27T15:25:06.746 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-27T15:25:06.747 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-27T15:25:06.748 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-27T15:25:06.749 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-27T15:25:06.749 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-27T15:25:06.749 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-27T15:25:06.749 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-27T15:25:06.837 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-27T15:25:06.837 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-27T15:25:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-27T15:25:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-27T15:25:06.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-27T15:25:06.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-27T15:25:06.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-27T15:25:06.943 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-27T15:25:06.943 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-27T15:25:06.943 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-27T15:25:06.943 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-27T15:25:06.944 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-27T15:25:06.945 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-27T15:25:06.946 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-27T15:25:06.947 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-27T15:25:06.948 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-27T15:25:06.948 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-27T15:25:06.948 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-27T15:25:06.948 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-27T15:25:06.948 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-27T15:25:07.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-27T15:25:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-27T15:25:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-27T15:25:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-27T15:25:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-27T15:25:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-27T15:25:07.040 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-27T15:25:07.040 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-27T15:25:07.040 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-27T15:25:07.040 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-27T15:25:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-27T15:25:07.042 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-27T15:25:07.043 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-27T15:25:07.044 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-27T15:25:07.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-27T15:25:07.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-27T15:25:07.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-27T15:25:07.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-27T15:25:07.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-27T15:25:07.140 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-27T15:25:07.141 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-27T15:25:07.141 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-27T15:25:07.141 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-27T15:25:07.142 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-27T15:25:07.237 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-27T15:25:07.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-27T15:25:07.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-27T15:25:07.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-27T15:25:07.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-27T15:25:07.338 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-27T15:25:07.338 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-27T15:25:07.338 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-27T15:25:07.339 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-27T15:25:07.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-27T15:25:07.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-27T15:25:07.441 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-27T15:25:07.441 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-27T15:25:07.441 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-27T15:25:07.441 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-27T15:25:07.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-27T15:25:07.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-27T15:25:07.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-27T15:25:07.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-27T15:25:07.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-27T15:25:07.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-27T15:25:07.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-27T15:25:07.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-27T15:25:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-27T15:25:07.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-27T15:25:07.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-27T15:25:07.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-27T15:25:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-27T15:25:07.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-27T15:25:07.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-27T15:25:08.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-27T15:25:08.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-27T15:25:08.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-27T15:25:08.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-27T15:25:08.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-27T15:25:08.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-27T15:25:08.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-27T15:25:08.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-27T15:25:08.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-27T15:25:08.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-27T15:25:08.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-27T15:25:08.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-27T15:25:08.737 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-27T15:25:08.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-27T15:25:08.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-27T15:25:08.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-27T15:25:08.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-27T15:25:08.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-27T15:25:08.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-27T15:25:08.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-27T15:25:08.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-27T15:25:08.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-27T15:25:08.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-27T15:25:08.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-27T15:25:08.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-27T15:25:08.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-27T15:25:08.842 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-27T15:25:08.843 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-27T15:25:08.844 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-27T15:25:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-27T15:25:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-27T15:25:08.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-27T15:25:08.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-27T15:25:08.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-27T15:25:08.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-27T15:25:09.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-27T15:25:09.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-27T15:25:09.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-27T15:25:09.038 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-27T15:25:09.039 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-27T15:25:09.039 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-27T15:25:09.039 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-27T15:25:09.137 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-27T15:25:09.137 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-27T15:25:09.137 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-27T15:25:09.138 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-27T15:25:09.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-27T15:25:09.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-27T15:25:09.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-27T15:25:09.139 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-27T15:25:09.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-27T15:25:09.238 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-27T15:25:09.239 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-27T15:25:09.240 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-27T15:25:09.241 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-27T15:25:09.241 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-27T15:25:09.241 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-27T15:25:09.345 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-27T15:25:09.345 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-27T15:25:09.345 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-27T15:25:09.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-27T15:25:09.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-27T15:25:09.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-27T15:25:09.438 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-27T15:25:09.439 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-27T15:25:09.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-27T15:25:09.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-27T15:25:09.440 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-27T15:25:09.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-27T15:25:09.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-27T15:25:09.537 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-27T15:25:09.538 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-27T15:25:09.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-27T15:25:09.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-27T15:25:09.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-27T15:25:09.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-27T15:25:09.539 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-27T15:25:09.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-27T15:25:09.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-27T15:25:09.638 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-27T15:25:09.639 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-27T15:25:09.640 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-27T15:25:09.738 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-27T15:25:09.739 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-27T15:25:09.740 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-27T15:25:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-27T15:25:09.742 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-27T15:25:09.742 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-27T15:25:09.837 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-27T15:25:09.838 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-27T15:25:09.839 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-27T15:25:09.840 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-27T15:25:09.841 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-27T15:25:09.937 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-27T15:25:09.937 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-27T15:25:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-27T15:25:09.939 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-27T15:25:09.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-27T15:25:09.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-27T15:25:09.940 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-27T15:25:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-27T15:25:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-27T15:25:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-27T15:25:10.037 INFO:teuthology.orchestra.run.smithi156.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-27T15:25:18.537 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileJava 2019-11-27T15:25:18.537 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processResources 2019-11-27T15:25:18.538 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :classes 2019-11-27T15:25:18.938 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:25:18.938 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileTestJava 2019-11-27T15:25:18.938 INFO:teuthology.orchestra.run.smithi156.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T15:25:18.939 INFO:teuthology.orchestra.run.smithi156.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T15:25:18.939 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:25:18.939 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T15:25:18.939 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :testClasses 2019-11-27T15:25:27.243 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:25:27.243 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :test 2019-11-27T15:25:27.243 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:25:27.243 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-27T15:25:38.608 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:25:46.085 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.615 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:25:46.092 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.663 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:25:46.145 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.664 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:25:46.146 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.667 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:25:46.149 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.672 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:25:46.154 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.779 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:25:46.256 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.795 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:25:46.277 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:25:38.798 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:25:46.280 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:26:26.338 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:26:26.338 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-27T15:26:33.238 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:26:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-27T15:26:36.938 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:26:36.938 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-27T15:26:43.438 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:26:43.438 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-27T15:28:08.339 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:08.339 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-27T15:28:17.039 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:17.039 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-27T15:28:17.439 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:17.439 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-27T15:28:18.839 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:18.839 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-27T15:28:21.939 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:21.940 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-27T15:28:28.439 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:28:28.440 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-27T15:29:22.240 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:29:22.252 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-27T15:29:36.340 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:29:36.340 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-27T15:32:10.006 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:32:17.481 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.020 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:32:17.496 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.021 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:17.498 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.023 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:32:17.501 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.026 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:17.504 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.029 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:32:17.507 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.270 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:17.747 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.283 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:32:17.761 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:32:10.356 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:32:17.831 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:33:19.241 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:19.242 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-27T15:33:33.041 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-27T15:33:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:35.042 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-27T15:33:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:39.642 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-27T15:33:45.241 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:45.242 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-27T15:33:55.942 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:33:55.942 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-27T15:34:36.342 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:34:36.342 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-27T15:34:46.142 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:34:46.142 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-27T15:34:46.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:34:46.642 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-27T15:34:47.942 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:34:47.942 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-27T15:35:33.938 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T15:35:33.908+0000 f4fe1700 -1 handle_data failed with exit code -104 2019-11-27T15:35:35.342 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:35:35.342 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-27T15:35:42.742 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:35:42.742 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-27T15:37:04.142 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:37:04.143 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-27T15:37:18.542 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:37:18.542 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-27T15:37:21.204 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:37:28.678 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.217 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:37:28.691 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.219 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:37:28.696 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.223 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:37:28.700 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.233 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:37:28.710 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.237 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:37:28.714 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.409 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:37:28.883 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.425 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:37:28.902 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:37:21.430 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:37:28.907 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:38:00.342 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:38:00.343 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-27T15:38:08.442 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:38:08.442 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-27T15:42:22.135 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:29.608 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.182 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:29.657 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.183 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:29.659 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.184 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:29.660 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.187 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:29.664 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.189 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:29.666 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.309 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:29.785 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.312 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:29.789 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:22.356 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:29.830 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.357 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:39.831 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.373 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:39.847 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.373 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:39.849 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.375 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:39.851 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.385 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:39.862 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.388 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:39.865 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.403 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:42:39.880 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.422 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:42:39.896 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:42:32.432 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:42:39.908 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:43.998 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:47:51.472 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.015 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:47:51.491 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.016 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:47:51.490 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.016 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:47:51.492 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.018 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:47:51.494 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.028 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:47:51.504 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.208 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:47:51.684 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.260 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:47:51.736 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:47:44.288 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:47:51.762 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.867 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:50:51.342 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.872 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:50:51.346 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.912 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:50:51.387 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.915 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:50:51.391 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.920 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:50:51.396 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.925 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:50:51.401 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.957 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:50:51.431 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:43.988 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:50:51.463 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:50:44.022 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:50:51.498 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:51:00.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:51:00.643 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-27T15:51:11.144 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:51:11.144 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-27T15:52:41.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:52:41.643 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-27T15:52:49.443 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:52:49.443 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-27T15:52:55.496 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:53:02.970 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.502 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:53:02.977 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.511 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:53:02.987 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.513 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:53:02.989 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.517 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:53:02.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.518 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:53:02.994 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.600 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:53:03.075 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.617 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:53:03.092 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:52:55.665 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:53:03.139 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:53:43.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:53:43.043 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-27T15:53:50.644 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:53:50.644 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-27T15:54:06.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:54:06.643 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-27T15:54:22.743 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:54:22.744 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-27T15:54:25.843 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:54:25.843 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-27T15:54:40.943 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:54:40.943 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-27T15:54:48.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:54:48.043 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-27T15:55:14.843 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:55:14.843 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-27T15:55:21.743 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:55:21.743 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-27T15:56:04.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:56:04.643 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-27T15:56:16.843 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:56:16.843 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-27T15:56:55.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:56:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-27T15:57:05.543 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:57:05.543 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-27T15:57:54.543 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:57:54.543 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-27T15:58:09.163 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:58:16.637 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.172 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:58:16.649 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.175 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:58:16.649 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.176 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:58:16.652 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.178 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:58:16.654 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.178 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:58:16.654 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.354 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:58:16.830 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.361 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:58:16.837 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:09.382 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:58:16.856 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:58:15.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:58:15.643 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-27T15:59:05.773 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:59:13.247 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.777 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:59:13.251 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.804 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:59:13.279 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.815 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:59:13.291 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.818 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:59:13.294 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.844 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:00:59:13.317 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.860 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:59:13.335 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.885 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:59:13.361 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:05.911 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:00:59:13.387 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T15:59:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T15:59:23.543 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-27T15:59:46.443 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:00:28.926 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-27T16:00:54.644 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:00:54.644 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-27T16:03:19.360 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:03:26.834 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.372 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:03:26.846 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.373 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:03:26.849 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.379 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:03:26.855 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.384 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:03:26.860 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.387 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:03:26.864 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.532 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:03:27.008 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.533 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:03:27.009 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:03:19.577 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:03:27.051 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.634 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:07:35.108 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.643 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:07:35.117 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.675 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:07:35.150 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.680 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:07:35.156 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.681 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:07:35.157 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.718 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:07:35.194 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.803 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:07:35.279 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.820 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:07:35.296 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:07:27.824 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:07:35.298 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.551 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:08:39.024 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.555 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:08:39.031 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.557 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:08:39.031 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.558 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:08:39.033 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.574 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:08:39.050 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.581 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:08:39.057 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.613 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:08:39.088 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.650 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:08:39.124 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:08:31.666 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:08:39.141 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:09:21.143 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:09:21.144 INFO:teuthology.orchestra.run.smithi156.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-27T16:10:07.943 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:07.944 INFO:teuthology.orchestra.run.smithi156.stdout:---------------------------------------------------------------------- 2019-11-27T16:10:07.944 INFO:teuthology.orchestra.run.smithi156.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-27T16:10:07.944 INFO:teuthology.orchestra.run.smithi156.stdout:---------------------------------------------------------------------- 2019-11-27T16:10:08.187 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:08.187 INFO:teuthology.orchestra.run.smithi156.stdout:BUILD SUCCESSFUL in 45m 7s 2019-11-27T16:10:08.187 INFO:teuthology.orchestra.run.smithi156.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-27T16:10:08.504 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:10:08.675 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.673+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.710 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.708+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:08.710 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.708+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.741+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:08.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.741+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.749 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.748+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:08.750 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.748+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.758 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.756+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:08.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.975+0000 7fc64c619ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:10:08.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.975+0000 7fc64c619ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:10:08.977 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.975+0000 7fc64c619ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:10:08.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.975+0000 7fc64c619ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:10:08.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.975+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.983+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.983+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:08.996 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.994+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:08.996 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:08.994+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.003+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:09.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.003+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.012+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:09.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.012+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.032+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:09.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.032+0000 7fc64c619ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:10:09.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.032+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.044 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.042+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:09.044 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.042+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.050+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:09.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.050+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.059+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:09.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.059+0000 7fc64c619ec0 20 zonegroup default 2019-11-27T16:10:09.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.059+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.065+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:09.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.065+0000 7fc64c619ec0 10 Cannot find current period zone using local zone 2019-11-27T16:10:09.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.065+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.071+0000 7fc64c619ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:09.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.071+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.079+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:09.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.079+0000 7fc64c619ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:09.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.090+0000 7fc64c619ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:09.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.090+0000 7fc64c619ec0 20 zone default found 2019-11-27T16:10:09.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.090+0000 7fc64c619ec0 20 started sync module instance, tier type = 2019-11-27T16:10:09.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.090+0000 7fc64c619ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:10:09.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=0 2019-11-27T16:10:09.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=1 2019-11-27T16:10:09.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=2 2019-11-27T16:10:09.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=3 2019-11-27T16:10:09.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=4 2019-11-27T16:10:09.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=5 2019-11-27T16:10:09.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.499+0000 7fc64c619ec0 20 add_watcher() i=6 2019-11-27T16:10:09.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.584+0000 7fc64c619ec0 20 add_watcher() i=7 2019-11-27T16:10:09.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.584+0000 7fc64c619ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:10:09.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.584+0000 7fc60a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:10:09.589 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.587+0000 7fc639846700 0 -- 172.21.15.156:0/1696242461 >> v1:172.21.15.3:6789/0 conn(0x55c6d0580740 legacy=0x55c6d05a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T16:10:09.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:09.628+0000 7fc639846700 0 -- 172.21.15.156:0/3192823873 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7fc57c017570 msgr2=0x7fc57c019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:11.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.122+0000 7fc580ff9700 20 reqs_thread_entry: start 2019-11-27T16:10:11.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.122+0000 7fc57a7fc700 20 reqs_thread_entry: start 2019-11-27T16:10:11.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.122+0000 7fc64c619ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:10:11.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.123+0000 7fc578ff9700 20 reqs_thread_entry: start 2019-11-27T16:10:11.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.123+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:10:11.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.169+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:11.186 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.185+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:11.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.455', time=2019-11-27T17:32:28.124736+0000, chain.objs.size()=9 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.1 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.1_1 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.2 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.2_1 2019-11-27T16:10:11.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.3 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.201+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.3_1 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.4 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.4_1 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~G48bzl-TYIF2QPtMHNIydGRlTL4Ck1l.5 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.614', time=2019-11-27T17:46:26.776015+0000, chain.objs.size()=19 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.1 2019-11-27T16:10:11.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.1_1 2019-11-27T16:10:11.207 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.202+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.2 2019-11-27T16:10:11.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.624+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.2_1 2019-11-27T16:10:11.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.3 2019-11-27T16:10:11.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.3_1 2019-11-27T16:10:11.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.4 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.4_1 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.5 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.5_1 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.6 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.6_1 2019-11-27T16:10:11.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.7 2019-11-27T16:10:11.636 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.632+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.7_1 2019-11-27T16:10:11.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.976+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.8 2019-11-27T16:10:11.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.976+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.8_1 2019-11-27T16:10:11.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:11.976+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.9 2019-11-27T16:10:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.050+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.9_1 2019-11-27T16:10:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.050+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~xGbhvpn9VyP73MqKtsbaYIbApqK8BVn.10 2019-11-27T16:10:12.207 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.205+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.287+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:10:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.379+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:12.411 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.409+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:12.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T16:10:12.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.467', time=2019-11-27T17:33:18.021289+0000, chain.objs.size()=7 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.1 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.1_1 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.1_2 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.2 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.2_1 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.2_2 2019-11-27T16:10:12.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~kJgJ9AoKXakyqneMXN70IVBiY4hLnDx.3 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.622', time=2019-11-27T17:49:05.768645+0000, chain.objs.size()=16 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.1 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.1_1 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.1_2 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.2 2019-11-27T16:10:12.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.2_1 2019-11-27T16:10:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.681+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.2_2 2019-11-27T16:10:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.681+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.3 2019-11-27T16:10:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.715+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.3_1 2019-11-27T16:10:12.723 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.721+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.3_2 2019-11-27T16:10:12.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.4 2019-11-27T16:10:12.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.4_1 2019-11-27T16:10:12.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.4_2 2019-11-27T16:10:12.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.5 2019-11-27T16:10:12.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.5_1 2019-11-27T16:10:12.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.5_2 2019-11-27T16:10:12.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:12.794+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~Pe1LEzq92mHnbcKBWH_jRInK4i4unbE.6 2019-11-27T16:10:13.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.179+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:13.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.267+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:10:13.306 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.304+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.321+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:13.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:13.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.418', time=2019-11-27T17:29:31.585349+0000, chain.objs.size()=9 2019-11-27T16:10:13.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.1 2019-11-27T16:10:13.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.1_1 2019-11-27T16:10:13.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.2 2019-11-27T16:10:13.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.2_1 2019-11-27T16:10:13.339 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.3 2019-11-27T16:10:13.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.3_1 2019-11-27T16:10:13.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.4 2019-11-27T16:10:13.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.4_1 2019-11-27T16:10:13.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.336+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.5 2019-11-27T16:10:13.437 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.435+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:13.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.512+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:10:13.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.554+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.569+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:13.579 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.577+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.625+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:10:13.667 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.665+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.682+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:13.709 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.708+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.743+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:10:13.789 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.788+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:13.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.807+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:13.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.668', time=2019-11-27T17:53:45.628238+0000, chain.objs.size()=9 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__multipart_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.1 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__shadow_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.1_1 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__multipart_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.2 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__shadow_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.2_1 2019-11-27T16:10:13.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__multipart_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.3 2019-11-27T16:10:13.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__shadow_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.3_1 2019-11-27T16:10:13.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__multipart_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.4 2019-11-27T16:10:13.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__shadow_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.4_1 2019-11-27T16:10:13.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:13.820+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.30__multipart_key1.2~dR7HU1WGAdTDVDWHz08KTnHwXv-MQBp.5 2019-11-27T16:10:14.098 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.097+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:14.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.162+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:10:14.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.200+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:14.220 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.218+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:14.239 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.461', time=2019-11-27T17:32:57.741500+0000, chain.objs.size()=7 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.1 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.1_1 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.1_2 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.2 2019-11-27T16:10:14.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.2_1 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.2_2 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~AfdRPVS52amkuegzmEouBfMp2oqY-Qc.3 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.510', time=2019-11-27T17:34:38.481836+0000, chain.objs.size()=9 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__multipart_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.1 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__shadow_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.1_1 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__multipart_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.2 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__shadow_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.2_1 2019-11-27T16:10:14.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.237+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__multipart_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.3 2019-11-27T16:10:14.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.342+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__shadow_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.3_1 2019-11-27T16:10:14.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.771+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__multipart_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.4 2019-11-27T16:10:14.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.771+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__shadow_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.4_1 2019-11-27T16:10:14.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.771+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.24__multipart_key1.2~ndShlJSQLPZ0ILRYKBvD-MeKL7DYn0R.5 2019-11-27T16:10:14.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:14.897+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:15.045 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.043+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:10:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.120+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:15.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.157+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:15.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.416', time=2019-11-27T17:29:25.850629+0000, chain.objs.size()=9 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.1 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.1_1 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.2 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.2_1 2019-11-27T16:10:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.3 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.3_1 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.4 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__shadow_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.4_1 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.17__multipart_key1.2~ra01AiETShT8QKoFFCk300JiEVesS_u.5 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.473', time=2019-11-27T17:33:28.329191+0000, chain.objs.size()=7 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.1 2019-11-27T16:10:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.1_1 2019-11-27T16:10:15.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.200+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.1_2 2019-11-27T16:10:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.2 2019-11-27T16:10:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.442+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.2_1 2019-11-27T16:10:15.495 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.2_2 2019-11-27T16:10:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~PhAnsbv_N-5APiUThDjn-bU_wanubR5.3 2019-11-27T16:10:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.630', time=2019-11-27T17:50:58.566908+0000, chain.objs.size()=16 2019-11-27T16:10:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.1 2019-11-27T16:10:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.1_1 2019-11-27T16:10:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.494+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.1_2 2019-11-27T16:10:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.594+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.2 2019-11-27T16:10:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.594+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.2_1 2019-11-27T16:10:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.594+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.2_2 2019-11-27T16:10:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.594+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.3 2019-11-27T16:10:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.594+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.3_1 2019-11-27T16:10:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.680+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.3_2 2019-11-27T16:10:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.680+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.4 2019-11-27T16:10:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.740+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.4_1 2019-11-27T16:10:15.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.937+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.4_2 2019-11-27T16:10:15.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.937+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.5 2019-11-27T16:10:15.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.937+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.5_1 2019-11-27T16:10:15.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.937+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.5_2 2019-11-27T16:10:15.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:15.937+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~w1G9uwLSPjZc60sLxDGEKRsQM9bBpom.6 2019-11-27T16:10:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.160+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:16.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.292+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:10:16.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.343+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:16.367 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.366+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:16.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.377+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:16.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.422+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:10:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.497+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:16.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.535+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.387', time=2019-11-27T17:28:11.454279+0000, chain.objs.size()=9 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__multipart_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.1 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__shadow_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.1_1 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__multipart_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.2 2019-11-27T16:10:16.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__shadow_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.2_1 2019-11-27T16:10:16.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__multipart_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.3 2019-11-27T16:10:16.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__shadow_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.3_1 2019-11-27T16:10:16.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__multipart_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.4 2019-11-27T16:10:16.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__shadow_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.4_1 2019-11-27T16:10:16.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.561+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.15__multipart_key1.2~JitAqi_YrEclt2q2pDyXHk3O0mLUhlq.5 2019-11-27T16:10:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:16.943+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.029+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:10:17.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.080+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.106+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:17.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.120+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.158+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:10:17.209 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.208+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.225 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.223+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.234+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.234+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~NAQokqV_eg08HY1YHCFWI18UWsa7mDB', time=2019-11-27T18:09:59.136133+0000, chain.objs.size()=0 2019-11-27T16:10:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.234+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:17.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.305+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:10:17.366 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.364+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.388 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.386+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:17.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.395+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.446 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.444+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:10:17.483 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.481+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:17.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.497+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.529', time=2019-11-27T17:35:38.346799+0000, chain.objs.size()=9 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__multipart_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.1 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__shadow_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.1_1 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__multipart_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.2 2019-11-27T16:10:17.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__shadow_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.2_1 2019-11-27T16:10:17.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__multipart_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.3 2019-11-27T16:10:17.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__shadow_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.3_1 2019-11-27T16:10:17.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__multipart_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.4 2019-11-27T16:10:17.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__shadow_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.4_1 2019-11-27T16:10:17.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.511+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.25__multipart_key1.2~scGt4auCbdHCERxXyudPI0TAZL5A0p5.5 2019-11-27T16:10:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:17.883+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:18.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.002+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:10:18.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.071+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.093+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:18.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.108+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.156+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:10:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.203+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.225 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.223+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.554', time=2019-11-27T17:37:06.121543+0000, chain.objs.size()=9 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__multipart_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.1 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__shadow_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.1_1 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__multipart_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.2 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__shadow_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.2_1 2019-11-27T16:10:18.244 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__multipart_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.3 2019-11-27T16:10:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.241+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__shadow_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.3_1 2019-11-27T16:10:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.242+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__multipart_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.4 2019-11-27T16:10:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.242+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__shadow_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.4_1 2019-11-27T16:10:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.242+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.26__multipart_file.mpg.2~kdsMQqtBH-3UURA8WXaTLIJyxPpseH6.5 2019-11-27T16:10:18.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.531+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:18.653 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.651+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:10:18.719 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.717+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.749 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.748+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:18.758 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.757+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.807 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.806+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:10:18.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.873+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.889+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:18.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.901+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:18.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.937+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:10:18.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:18.991+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.010+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:19.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.018+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.062+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:10:19.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.108+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:19.127 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.125+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:19.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.134+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:19.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.166+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:10:19.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.240+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:19.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.272+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:19.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T16:10:19.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF', time=2019-11-27T17:26:24.685519+0000, chain.objs.size()=9 2019-11-27T16:10:19.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__multipart_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.1 2019-11-27T16:10:19.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__shadow_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.1_1 2019-11-27T16:10:19.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__multipart_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.2 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__shadow_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.2_1 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__multipart_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.3 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__shadow_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.3_1 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__multipart_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.4 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__shadow_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.4_1 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.13__multipart_key1.2~eP1IPGuP7eMkbipbacL35lxPAU-kUgF.5 2019-11-27T16:10:19.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.439', time=2019-11-27T17:31:29.810461+0000, chain.objs.size()=9 2019-11-27T16:10:19.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.1 2019-11-27T16:10:19.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.1_1 2019-11-27T16:10:19.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.324+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.2 2019-11-27T16:10:19.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.652+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.2_1 2019-11-27T16:10:19.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.652+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.3 2019-11-27T16:10:19.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.652+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.3_1 2019-11-27T16:10:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.652+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.4 2019-11-27T16:10:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.686+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.4_1 2019-11-27T16:10:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.686+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~cNwVDYT5yDiYfHMBqKSuu-vXv14yAYL.5 2019-11-27T16:10:19.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ', time=2019-11-27T17:54:18.340074+0000, chain.objs.size()=27 2019-11-27T16:10:19.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.1 2019-11-27T16:10:19.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.2 2019-11-27T16:10:19.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.3 2019-11-27T16:10:19.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.4 2019-11-27T16:10:19.747 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.744+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.5 2019-11-27T16:10:19.883 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.6 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.7 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.8 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.9 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.10 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.11 2019-11-27T16:10:19.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.12 2019-11-27T16:10:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.13 2019-11-27T16:10:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.14 2019-11-27T16:10:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.15 2019-11-27T16:10:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.881+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.16 2019-11-27T16:10:19.966 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:19.964+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.BZRb_XsXm4axgiUDP5Ed9557mwNijzu.17 2019-11-27T16:10:20.026 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.024+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.AYWLbq0l4DpHMJcnpOpHg70Rb_hzVSy.18 2019-11-27T16:10:20.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.041+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.ZLROgespCa_-XopaC-6zp6TB7kFaRBi.19 2019-11-27T16:10:20.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.11ghgo9PjLIDE5mAkxUuNErApIuToAn.20 2019-11-27T16:10:20.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.21 2019-11-27T16:10:20.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.22 2019-11-27T16:10:20.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.23 2019-11-27T16:10:20.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.24 2019-11-27T16:10:20.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.25 2019-11-27T16:10:20.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.26 2019-11-27T16:10:20.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.081+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.31__multipart_key1.2~NCSmiZXJpiQifwjrF-ovopvFvPdFRpJ.27 2019-11-27T16:10:20.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.204+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:20.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.336+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:10:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.402+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.432 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.430+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.440+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.476 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.474+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:10:20.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.514+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.531 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.529+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:20.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.538+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.576 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.574+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:10:20.667 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.665+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.701+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:20.724 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.722+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.786+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:10:20.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.876+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.916 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.914+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:20.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.929+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:20.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:20.996+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:10:21.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.067+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:21.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.089+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.116+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.116+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.653', time=2019-11-27T17:52:45.140809+0000, chain.objs.size()=9 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.116+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__multipart_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.1 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.116+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__shadow_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.1_1 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.116+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__multipart_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.2 2019-11-27T16:10:21.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__shadow_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.2_1 2019-11-27T16:10:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__multipart_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.3 2019-11-27T16:10:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__shadow_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.3_1 2019-11-27T16:10:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__multipart_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.4 2019-11-27T16:10:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__shadow_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.4_1 2019-11-27T16:10:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.117+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.29__multipart_key1.2~CdUHlmNaGUprMm1JJER4MGElSyYRXD4.5 2019-11-27T16:10:21.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.414+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:21.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.500+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:10:21.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.567+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:21.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.592+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.447', time=2019-11-27T17:32:04.550567+0000, chain.objs.size()=9 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.1 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.1_1 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.2 2019-11-27T16:10:21.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.2_1 2019-11-27T16:10:21.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.3 2019-11-27T16:10:21.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.3_1 2019-11-27T16:10:21.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.4 2019-11-27T16:10:21.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__shadow_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.4_1 2019-11-27T16:10:21.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.618+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.20__multipart_key1.2~0GuK2KxJ8Bihw4DzZffMW88yXhXWBrM.5 2019-11-27T16:10:21.945 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:21.943+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:22.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.079+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:10:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.135+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:22.153 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.151+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:22.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.159+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.190+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:10:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.243+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.262+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:22.276 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm', time=2019-11-27T17:38:04.591081+0000, chain.objs.size()=5 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.27__multipart_key1.2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm.7 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.27__shadow_key1.2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm.7_1 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.27__multipart_key1.2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm.10 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.27__shadow_key1.2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm.10_1 2019-11-27T16:10:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.274+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.27__multipart_key1.2~uOgqIQFrg3Fw546XUaL4PxszZDNOJBm.13 2019-11-27T16:10:22.476 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.475+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:22.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.565+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:10:22.619 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.617+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:22.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.639+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:22.678 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T16:10:22.678 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.589', time=2019-11-27T17:42:29.306288+0000, chain.objs.size()=21 2019-11-27T16:10:22.679 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.1 2019-11-27T16:10:22.679 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.1_1 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.2 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.2_1 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.3 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.3_1 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.4 2019-11-27T16:10:22.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.676+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.4_1 2019-11-27T16:10:22.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.677+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.5 2019-11-27T16:10:22.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.677+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.5_1 2019-11-27T16:10:22.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.677+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.6 2019-11-27T16:10:22.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.677+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.6_1 2019-11-27T16:10:22.915 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.913+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.7 2019-11-27T16:10:22.916 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.913+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.7_1 2019-11-27T16:10:22.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.988+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.8 2019-11-27T16:10:22.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:22.988+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.8_1 2019-11-27T16:10:23.036 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.035+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.9 2019-11-27T16:10:23.036 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.035+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.9_1 2019-11-27T16:10:23.037 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.035+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.10 2019-11-27T16:10:23.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.10_1 2019-11-27T16:10:23.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~FKJGXjCkDQK4lnQg0PTyYxEjvUpKq_K.11 2019-11-27T16:10:23.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.638', time=2019-11-27T17:51:03.626984+0000, chain.objs.size()=16 2019-11-27T16:10:23.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.1 2019-11-27T16:10:23.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.1_1 2019-11-27T16:10:23.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.1_2 2019-11-27T16:10:23.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.2 2019-11-27T16:10:23.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.249+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.2_1 2019-11-27T16:10:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.263+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.2_2 2019-11-27T16:10:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.264+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.3 2019-11-27T16:10:23.322 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.320+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.3_1 2019-11-27T16:10:23.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.327+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.3_2 2019-11-27T16:10:23.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.473+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.4 2019-11-27T16:10:23.482 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.480+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.4_1 2019-11-27T16:10:23.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.502+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.4_2 2019-11-27T16:10:23.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.502+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.5 2019-11-27T16:10:23.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.502+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.5_1 2019-11-27T16:10:23.504 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.502+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.5_2 2019-11-27T16:10:23.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.506+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~zhshO4t_QS9B1slDfPaN0-WYAPvF68C.6 2019-11-27T16:10:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.696+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:23.781 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.779+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:10:23.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.816+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:23.831 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.829+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.431', time=2019-11-27T17:33:21.404045+0000, chain.objs.size()=5 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.19__shadow_.1FLpvmHdniTRimG7ObMxWcMWnGSYec7_1 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.19__shadow_.1FLpvmHdniTRimG7ObMxWcMWnGSYec7_2 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.19__shadow_.1FLpvmHdniTRimG7ObMxWcMWnGSYec7_3 2019-11-27T16:10:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.19__shadow_.1FLpvmHdniTRimG7ObMxWcMWnGSYec7_4 2019-11-27T16:10:23.868 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:23.865+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.19__shadow_.1FLpvmHdniTRimG7ObMxWcMWnGSYec7_5 2019-11-27T16:10:24.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.080+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:24.169 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.167+0000 7fc64c619ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:10:24.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.211+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:24.231 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.229+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:24.255 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T16:10:24.255 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.602', time=2019-11-27T17:44:39.694910+0000, chain.objs.size()=21 2019-11-27T16:10:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.1 2019-11-27T16:10:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.1_1 2019-11-27T16:10:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.2 2019-11-27T16:10:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.2_1 2019-11-27T16:10:24.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.3 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.3_1 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.4 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.4_1 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.5 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.5_1 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.6 2019-11-27T16:10:24.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.253+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.6_1 2019-11-27T16:10:24.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.495+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.7 2019-11-27T16:10:24.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.535+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.7_1 2019-11-27T16:10:24.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.535+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.8 2019-11-27T16:10:24.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.535+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.8_1 2019-11-27T16:10:24.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.619+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.9 2019-11-27T16:10:24.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.622+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.9_1 2019-11-27T16:10:24.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.622+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.10 2019-11-27T16:10:24.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.622+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__shadow_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.10_1 2019-11-27T16:10:24.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.622+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.28__multipart_key1.2~OduTcipFXbI2QhFyG72yECB93y57J89.11 2019-11-27T16:10:24.841 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.839+0000 7fc64c619ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T16:10:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.958+0000 7fc64c619ec0 20 remove_watcher() i=0 2019-11-27T16:10:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.958+0000 7fc64c619ec0 2 removed watcher, disabling cache 2019-11-27T16:10:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:24.993+0000 7fc64c619ec0 20 remove_watcher() i=1 2019-11-27T16:10:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.024+0000 7fc64c619ec0 20 remove_watcher() i=2 2019-11-27T16:10:25.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.075+0000 7fc64c619ec0 20 remove_watcher() i=3 2019-11-27T16:10:25.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.118+0000 7fc64c619ec0 20 remove_watcher() i=4 2019-11-27T16:10:25.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.175+0000 7fc64c619ec0 20 remove_watcher() i=5 2019-11-27T16:10:25.249 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.248+0000 7fc64c619ec0 20 remove_watcher() i=6 2019-11-27T16:10:25.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.307+0000 7fc64c619ec0 20 remove_watcher() i=7 2019-11-27T16:10:25.320 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:10:25.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.513+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.538+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.538+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.547+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.547+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.555+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.555+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.562+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:25.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.825+0000 7f6426194ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:10:25.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.825+0000 7f6426194ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:10:25.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.825+0000 7f6426194ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:10:25.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.825+0000 7f6426194ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:10:25.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.826+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.834+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:25.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.834+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.855+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:25.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.855+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.874+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:25.876 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.874+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.893+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:25.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.893+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.906+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.906+0000 7f6426194ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:10:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.906+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.919 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.917+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.919 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.917+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.930+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:25.932 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.930+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.947+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:25.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.947+0000 7f6426194ec0 20 zonegroup default 2019-11-27T16:10:25.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.947+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.956+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.956+0000 7f6426194ec0 10 Cannot find current period zone using local zone 2019-11-27T16:10:25.959 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.957+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.965+0000 7f6426194ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:25.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.965+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:25.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.976+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:25.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:25.976+0000 7f6426194ec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:26.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.002+0000 7f6426194ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:26.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.002+0000 7f6426194ec0 20 zone default found 2019-11-27T16:10:26.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.002+0000 7f6426194ec0 20 started sync module instance, tier type = 2019-11-27T16:10:26.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.002+0000 7f6426194ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:10:26.401 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=0 2019-11-27T16:10:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=1 2019-11-27T16:10:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=2 2019-11-27T16:10:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=3 2019-11-27T16:10:27.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=4 2019-11-27T16:10:27.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=5 2019-11-27T16:10:27.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.399+0000 7f6426194ec0 20 add_watcher() i=6 2019-11-27T16:10:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.454+0000 7f6426194ec0 20 add_watcher() i=7 2019-11-27T16:10:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.454+0000 7f6426194ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:10:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.454+0000 7f63e3fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:10:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.476+0000 7f64133c1700 0 -- 172.21.15.156:0/2089372238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55a66690ed00 msgr2=0x55a66690f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:26.509+0000 7f6413bc2700 0 -- 172.21.15.156:0/1216849326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55a6668ee8c0 msgr2=0x55a6668edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:28.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.400+0000 7f63527fc700 20 reqs_thread_entry: start 2019-11-27T16:10:28.403 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.400+0000 7f634bfff700 20 reqs_thread_entry: start 2019-11-27T16:10:28.403 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.400+0000 7f6426194ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:10:28.403 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.401+0000 7f634a7fc700 20 reqs_thread_entry: start 2019-11-27T16:10:28.403 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.401+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:10:28.488 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.486+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.549+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:28.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.567+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.617 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.615+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:10:28.679 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.677+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.700 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.699+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:28.714 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.712+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.751+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:10:28.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.804+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.821+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:28.832 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.830+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.875+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:10:28.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.946+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:28.981+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.000+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.090+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:10:29.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.147+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.164+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.174+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.232+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:10:29.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.305+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.329+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.343 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.342+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.417 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.415+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:10:29.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.510+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.538+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.552+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.604+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:10:29.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.656+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.673+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.682+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.739 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.737+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:10:29.837 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.835+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.868 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.866+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.882+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:29.945+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:10:30.002 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.000+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.023 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.021+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.035 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.033+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.071+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:10:30.153 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.151+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.179+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.197 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.195+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.249+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:10:30.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.324+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.351+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.365 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.363+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.425+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:10:30.491 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.490+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.509+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.520+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.578 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.576+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:10:30.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.645+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.669+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.685 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.683+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.720+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:10:30.771 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.769+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.790 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.788+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.798 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.797+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.827+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:10:30.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.868+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.883+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:30.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.891+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:30.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:30.921+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:10:31.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.007+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.040+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.056+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.149+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:10:31.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.245+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.289 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.287+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.302+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.377+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:10:31.436 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.434+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.452+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.462+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.494+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:10:31.539 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.538+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.555+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.565 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.564+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.598 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.596+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:10:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.642+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.661 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.659+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.669+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.702+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:10:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.753+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.775+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.789+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.851 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.848+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:10:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.912+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:31.936 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.934+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:31.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:31.945+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.003+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:10:32.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.064+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.082+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.093 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.091+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.139+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:10:32.181 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.180+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.198+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.206+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.239+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:10:32.275 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.274+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.290 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.288+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.296+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.328+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:10:32.384 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.383+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.400+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.412+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.468 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.466+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:10:32.555 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.553+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.588+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.603+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.662+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:10:32.729 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.727+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.749+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.763 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.762+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.800+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:10:32.934 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.932+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:32.959 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.957+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:32.970 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:32.969+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.012+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:10:33.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.079+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.097+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.106+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.144+0000 7f6426194ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:10:33.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.199+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:33.221 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.219+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.228+0000 7f6426194ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.305+0000 7f6426194ec0 20 remove_watcher() i=0 2019-11-27T16:10:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.305+0000 7f6426194ec0 2 removed watcher, disabling cache 2019-11-27T16:10:33.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.348+0000 7f6426194ec0 20 remove_watcher() i=1 2019-11-27T16:10:33.380 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.379+0000 7f6426194ec0 20 remove_watcher() i=2 2019-11-27T16:10:33.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.440+0000 7f6426194ec0 20 remove_watcher() i=3 2019-11-27T16:10:33.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.483+0000 7f6426194ec0 20 remove_watcher() i=4 2019-11-27T16:10:33.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.530+0000 7f6426194ec0 20 remove_watcher() i=5 2019-11-27T16:10:33.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.571+0000 7f6426194ec0 20 remove_watcher() i=6 2019-11-27T16:10:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.613+0000 7f6426194ec0 20 remove_watcher() i=7 2019-11-27T16:10:33.627 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:10:33.747 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.745+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:33.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.768+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:33.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.768+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:33.781 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.779+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:33.781 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.779+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:33.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.785+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:33.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.785+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:33.794+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.066+0000 7fd1345eeec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:10:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.066+0000 7fd1345eeec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:10:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.066+0000 7fd1345eeec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:10:34.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.066+0000 7fd1345eeec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:10:34.069 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.066+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.082+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:34.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.082+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.103+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:34.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.103+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.118 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.116+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:34.118 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.117+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.137 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.135+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:34.137 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.135+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.145+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:34.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.145+0000 7fd1345eeec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:10:34.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.145+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.162+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:34.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.162+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.175+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.175+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.193 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.191+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:34.193 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.191+0000 7fd1345eeec0 20 zonegroup default 2019-11-27T16:10:34.193 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.191+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.201+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.201+0000 7fd1345eeec0 10 Cannot find current period zone using local zone 2019-11-27T16:10:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.201+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.220 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.218+0000 7fd1345eeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:34.220 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.219+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.231 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.229+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:34.231 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.229+0000 7fd1345eeec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:34.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.245+0000 7fd1345eeec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:34.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.245+0000 7fd1345eeec0 20 zone default found 2019-11-27T16:10:34.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.245+0000 7fd1345eeec0 20 started sync module instance, tier type = 2019-11-27T16:10:34.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.245+0000 7fd1345eeec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:10:34.679 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.677+0000 7fd1345eeec0 20 add_watcher() i=0 2019-11-27T16:10:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.677+0000 7fd1345eeec0 20 add_watcher() i=1 2019-11-27T16:10:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.677+0000 7fd1345eeec0 20 add_watcher() i=2 2019-11-27T16:10:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.678+0000 7fd1345eeec0 20 add_watcher() i=3 2019-11-27T16:10:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.678+0000 7fd1345eeec0 20 add_watcher() i=4 2019-11-27T16:10:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.678+0000 7fd1345eeec0 20 add_watcher() i=5 2019-11-27T16:10:34.716 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.714+0000 7fd1345eeec0 20 add_watcher() i=6 2019-11-27T16:10:34.725 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.724+0000 7fd1345eeec0 20 add_watcher() i=7 2019-11-27T16:10:34.726 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.724+0000 7fd1345eeec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:10:34.726 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.724+0000 7fd0f27dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:10:34.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.731+0000 7fd12201c700 0 -- 172.21.15.156:0/1194694139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a2b02bdce0 msgr2=0x55a2b02daef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T16:10:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:34.754+0000 7fd12201c700 0 -- 172.21.15.156:0/146044977 >> v2:172.21.15.156:3300/0 conn(0x55a2b02b0880 msgr2=0x55a2b02afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:36.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.189+0000 7fd068ff9700 20 reqs_thread_entry: start 2019-11-27T16:10:36.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.190+0000 7fd0627fc700 20 reqs_thread_entry: start 2019-11-27T16:10:36.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.190+0000 7fd1345eeec0 20 init_complete bucket index max shards: 0 2019-11-27T16:10:36.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.190+0000 7fd060ff9700 20 reqs_thread_entry: start 2019-11-27T16:10:36.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.190+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:10:36.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.249+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.269+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:36.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.284+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.355+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:10:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.440+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.471 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.470+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:36.489 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.487+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.561+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:10:36.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.644+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.668+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:36.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.681+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.725 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.723+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:10:36.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.771+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.791+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:36.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.802+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.838+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:10:36.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.877+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.893+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:36.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.902+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:36.937 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.935+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:10:36.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:36.996+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.016+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.027+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.080 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.078+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:10:37.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.139+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.167 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.165+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.176+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.232 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.231+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:10:37.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.298+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.314+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.324+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.375 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.373+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:10:37.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.434+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.452+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.462+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.517 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.515+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:10:37.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.572+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.590+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.601 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.599+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.640+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:10:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.693+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.711 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.709+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.720 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.718+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.786+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:10:37.853 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.851+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.876+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:37.892 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.890+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:37.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.939+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:10:37.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:37.996+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.013+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.022 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.021+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.066+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:10:38.138 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.136+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.160+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.172 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.170+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.318+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:10:38.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.377+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.393+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.404+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.439+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:10:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.482+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.500+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.509+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.546 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.544+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:10:38.612 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.610+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.639+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.665 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.663+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.729+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:10:38.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.822+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.851 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.849+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.862+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.904+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:10:38.954 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.953+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:38.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.969+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:38.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:38.978+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.022+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:10:39.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.070+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.087+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.099 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.097+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.136 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.135+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:10:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.184+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.202+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.217 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.215+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.264+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:10:39.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.317+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.335+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.342+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.398+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:10:39.483 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.481+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.510 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.508+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.538 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.536+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.599 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.597+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:10:39.653 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.651+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.672 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.670+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.685 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.683+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.729 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.727+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:10:39.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.799+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.844+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.863+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:39.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:39.942+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:10:40.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.025+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.046 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.045+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.058+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.107 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.105+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:10:40.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.193+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.231 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.229+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.241+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.309+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:10:40.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.379+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.404+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.415 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.414+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.469 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.467+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:10:40.527 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.525+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.543+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.555 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.553+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.603 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.601+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:10:40.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.650+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.687 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.686+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.697 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.696+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.735+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:10:40.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.775+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.792 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.790+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.800+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.855+0000 7fd1345eeec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:10:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.892+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.910 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.908+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:40.918 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.917+0000 7fd1345eeec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:40.998 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.996+0000 7fd1345eeec0 20 remove_watcher() i=0 2019-11-27T16:10:40.999 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:40.996+0000 7fd1345eeec0 2 removed watcher, disabling cache 2019-11-27T16:10:41.033 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.030+0000 7fd1345eeec0 20 remove_watcher() i=1 2019-11-27T16:10:41.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.056+0000 7fd1345eeec0 20 remove_watcher() i=2 2019-11-27T16:10:41.116 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.114+0000 7fd1345eeec0 20 remove_watcher() i=3 2019-11-27T16:10:41.160 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.159+0000 7fd1345eeec0 20 remove_watcher() i=4 2019-11-27T16:10:41.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.204+0000 7fd1345eeec0 20 remove_watcher() i=5 2019-11-27T16:10:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.262+0000 7fd1345eeec0 20 remove_watcher() i=6 2019-11-27T16:10:41.324 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.323+0000 7fd1345eeec0 20 remove_watcher() i=7 2019-11-27T16:10:41.331 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:10:41.476 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.474+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.494+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.494+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.507 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.506+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.506+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.513 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.511+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.513 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.512+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.519+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:41.728 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.726+0000 7fae4293aec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:10:41.728 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.726+0000 7fae4293aec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:10:41.728 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.726+0000 7fae4293aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:10:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.726+0000 7fae4293aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:10:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.726+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.735 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.733+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:41.735 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.733+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.743+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.743+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.750+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:41.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.750+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.766+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.766+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.773+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.773+0000 7fae4293aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:10:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.773+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.780+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.780+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.788+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.788+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.801+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:10:41.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.801+0000 7fae4293aec0 20 zonegroup default 2019-11-27T16:10:41.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.801+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.806+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.806+0000 7fae4293aec0 10 Cannot find current period zone using local zone 2019-11-27T16:10:41.808 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.806+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.814 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.812+0000 7fae4293aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:10:41.814 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.812+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.820+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:10:41.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.820+0000 7fae4293aec0 20 rados->read ofs=0 len=0 2019-11-27T16:10:41.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.831+0000 7fae4293aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:10:41.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.831+0000 7fae4293aec0 20 zone default found 2019-11-27T16:10:41.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.831+0000 7fae4293aec0 20 started sync module instance, tier type = 2019-11-27T16:10:41.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:41.831+0000 7fae4293aec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:10:42.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=0 2019-11-27T16:10:42.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=1 2019-11-27T16:10:42.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=2 2019-11-27T16:10:42.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=3 2019-11-27T16:10:42.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=4 2019-11-27T16:10:42.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=5 2019-11-27T16:10:42.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.198+0000 7fae4293aec0 20 add_watcher() i=6 2019-11-27T16:10:42.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.233+0000 7fae4293aec0 20 add_watcher() i=7 2019-11-27T16:10:42.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.233+0000 7fae4293aec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:10:42.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.233+0000 7fad83fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:10:42.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.251+0000 7fae2fb67700 0 -- 172.21.15.156:0/3882340475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c3c1f83980 msgr2=0x55c3c1f83d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:42.373 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:42.371+0000 7fae2fb67700 0 -- 172.21.15.156:0/3882340475 >> [v2:172.21.15.156:6823/10489,v1:172.21.15.156:6825/10489] conn(0x55c3c1f9a930 msgr2=0x55c3c1f9cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:10:43.926 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:43.924+0000 7fad6e7fc700 20 reqs_thread_entry: start 2019-11-27T16:10:43.926 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:43.924+0000 7fad67fff700 20 reqs_thread_entry: start 2019-11-27T16:10:43.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:43.925+0000 7fae4293aec0 20 init_complete bucket index max shards: 0 2019-11-27T16:10:43.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:43.925+0000 7fad667fc700 20 reqs_thread_entry: start 2019-11-27T16:10:43.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:43.925+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:10:44.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.018+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.055+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.079+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.155 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.153+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:10:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.239+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.261 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.260+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.269+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.305+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:10:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.349+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.366 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.365+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.379+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.428+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:10:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.477+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.492+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.501+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.543+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:10:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.589+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.604+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.612+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.662+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:10:44.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.735+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.750+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.760 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.758+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.810 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.808+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:10:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.858+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.876+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.887 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.883+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.917 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.916+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:10:44.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.955+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:44.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.970+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:44.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:44.978+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.011 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.009+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:10:45.079 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.077+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.120 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.118+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.133 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.132+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.186 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.185+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:10:45.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.285+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.324 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.322+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.342+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.399 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.398+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:10:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.462+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.489 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.487+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.501+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.541+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:10:45.612 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.610+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.641+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.658+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.720+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:10:45.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.766+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.786+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.794+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.829+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:10:45.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.870+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.887 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.885+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.892+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:45.930 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:45.928+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:10:46.016 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.015+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.041 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.040+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.053+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.103+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:10:46.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.161+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.187 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.185+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.202+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.244+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:10:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.299+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.321+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.336+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.386+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:10:46.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.452+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.490+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.510+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.562 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.560+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:10:46.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.630+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.657 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.655+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.669+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.710+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:10:46.772 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.770+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.791+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.802+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.850+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:10:46.937 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.935+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:46.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.970+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:46.990+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.056+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:10:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.128+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.149 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.148+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.157 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.156+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.208+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:10:47.292 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.290+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.323+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.346 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.344+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.411+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:10:47.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.460+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.482 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.480+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.491+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.523 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.521+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:10:47.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.612+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.648 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.646+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.675 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.673+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.730+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:10:47.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.794+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.815+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.826+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.875+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:10:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.935+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:47.970 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.968+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:47.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:47.978+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.030 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.028+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:10:48.072 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.070+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.086+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:48.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.094+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.121+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:10:48.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.164+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.188+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:48.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.196+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.228+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:10:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.266+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.284 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.282+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:48.292 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.291+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.328+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:10:48.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.583+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.621 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.619+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:48.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.638+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.702+0000 7fae4293aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:10:48.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.773+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.795+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:10:48.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.805+0000 7fae4293aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:10:48.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.896+0000 7fae4293aec0 20 remove_watcher() i=0 2019-11-27T16:10:48.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.896+0000 7fae4293aec0 2 removed watcher, disabling cache 2019-11-27T16:10:48.933 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.931+0000 7fae4293aec0 20 remove_watcher() i=1 2019-11-27T16:10:48.981 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:48.979+0000 7fae4293aec0 20 remove_watcher() i=2 2019-11-27T16:10:49.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:49.023+0000 7fae4293aec0 20 remove_watcher() i=3 2019-11-27T16:10:49.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:49.074+0000 7fae4293aec0 20 remove_watcher() i=4 2019-11-27T16:10:49.129 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:49.127+0000 7fae4293aec0 20 remove_watcher() i=5 2019-11-27T16:10:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:49.189+0000 7fae4293aec0 20 remove_watcher() i=6 2019-11-27T16:10:49.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:10:49.249+0000 7fae4293aec0 20 remove_watcher() i=7 2019-11-27T16:10:49.262 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-27T16:10:49.908 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :clean 2019-11-27T16:10:50.606 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileJava 2019-11-27T16:10:50.606 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processResources 2019-11-27T16:10:50.607 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :classes 2019-11-27T16:10:50.806 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:50.807 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileTestJava 2019-11-27T16:10:50.807 INFO:teuthology.orchestra.run.smithi156.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T16:10:50.807 INFO:teuthology.orchestra.run.smithi156.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T16:10:50.807 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:50.807 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T16:10:50.808 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :testClasses 2019-11-27T16:10:55.506 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:55.506 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :test 2019-11-27T16:10:55.507 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:55.507 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-27T16:10:58.306 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:10:59.068 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-27T16:11:03.406 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:03.406 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-27T16:11:06.006 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:06.006 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-27T16:11:12.306 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:12.306 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-27T16:11:15.207 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:15.207 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-27T16:11:22.806 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:22.806 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-27T16:11:29.006 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:29.006 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-27T16:11:30.606 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:30.606 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-27T16:11:35.606 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:35.606 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-27T16:11:43.306 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:43.306 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-27T16:11:43.608 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:43.608 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-27T16:11:44.606 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:44.606 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-27T16:11:50.506 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:11:50.506 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-27T16:12:04.308 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.051 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-27T16:15:19.054 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:13:50.869 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.055 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:13:50.896 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.055 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:13:51.103 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.055 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.055 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-27T16:15:19.055 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.055 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------- 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------- 2019-11-27T16:15:19.056 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:19.057 INFO:teuthology.orchestra.run.smithi156.stdout:BUILD SUCCESSFUL in 1m 23s 2019-11-27T16:15:19.057 INFO:teuthology.orchestra.run.smithi156.stdout:5 actionable tasks: 5 executed 2019-11-27T16:15:19.057 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:13:50.887 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.057 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:13:50.889 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.057 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:13:51.102 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.057 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:13:50.889 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.058 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:13:50.896 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.058 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:13:51.085 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:19.058 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:15:19.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.235+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.262+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.262+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.272+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.272+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.282 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.280+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.282 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.280+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.289+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:19.507 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.505+0000 7fcbf7827ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:15:19.507 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.505+0000 7fcbf7827ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:15:19.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.505+0000 7fcbf7827ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:15:19.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.505+0000 7fcbf7827ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:15:19.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.505+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.514+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.514+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.527 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.525+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:19.527 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.525+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.535 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.534+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:19.536 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.534+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.548+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:19.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.548+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.554+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.554+0000 7fcbf7827ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:15:19.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.554+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.562 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.560+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.562 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.561+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.572+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.572+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.583+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.583+0000 7fcbf7827ec0 20 zonegroup default 2019-11-27T16:15:19.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.583+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.591+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.591+0000 7fcbf7827ec0 10 Cannot find current period zone using local zone 2019-11-27T16:15:19.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.591+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.598+0000 7fcbf7827ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.598+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.606+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.606+0000 7fcbf7827ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:19.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.623+0000 7fcbf7827ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:19.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.623+0000 7fcbf7827ec0 20 zone default found 2019-11-27T16:15:19.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.623+0000 7fcbf7827ec0 20 started sync module instance, tier type = 2019-11-27T16:15:19.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:19.623+0000 7fcbf7827ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:15:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=0 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=1 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=2 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=3 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=4 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=5 2019-11-27T16:15:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.002+0000 7fcbf7827ec0 20 add_watcher() i=6 2019-11-27T16:15:20.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.037+0000 7fcbf7827ec0 20 add_watcher() i=7 2019-11-27T16:15:20.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.037+0000 7fcbf7827ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:15:20.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.038+0000 7fcbb57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:15:20.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.047+0000 7fcbe4253700 0 -- 172.21.15.156:0/1802265661 >> v2:172.21.15.3:3300/0 conn(0x5602ef287f20 msgr2=0x5602ef265540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T16:15:20.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.250+0000 7fcbe4253700 0 --2- 172.21.15.156:0/1802265661 >> v2:172.21.15.3:3300/0 conn(0x5602ef287f20 0x5602ef265540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T16:15:20.318 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:20.316+0000 7fcbe4a54700 0 -- 172.21.15.156:0/2419934261 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7fcb28017570 msgr2=0x7fcb28019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:21.825 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.823+0000 7fcb277fe700 20 reqs_thread_entry: start 2019-11-27T16:15:21.826 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.823+0000 7fcb257fa700 20 reqs_thread_entry: start 2019-11-27T16:15:21.826 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.823+0000 7fcbf7827ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:15:21.826 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.824+0000 7fcb137fe700 20 reqs_thread_entry: start 2019-11-27T16:15:21.826 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.824+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:15:21.874 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.872+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.889+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:21.903 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.902+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:21.946 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.945+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:15:21.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.984+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:21.999+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.008+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.040+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:15:22.078 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.076+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.094+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.103+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.139+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:15:22.186 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.184+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.207 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.206+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.214+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.256+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:15:22.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.336+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.367+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.384+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.442+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:15:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.516+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.548+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.566+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.636 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.634+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:15:22.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.711+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.747 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.745+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.766 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.764+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.813 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.811+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:15:22.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.855+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.870+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.880 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.878+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.910 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.908+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:15:22.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.942+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.958 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.957+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:22.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.965+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:22.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:22.996+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:15:23.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.056+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.079+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.089+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.140+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:15:23.224 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.222+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.245+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.255+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.295+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:15:23.366 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.364+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.386 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.384+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.395+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.442+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:15:23.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.483+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.497+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.506+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.546 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.545+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:15:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.587+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.603+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.612+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.642 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.641+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:15:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.698+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.714 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.713+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.721+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.768+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:15:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.838+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.868+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:23.883 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.881+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.927+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:15:23.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.978+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:23.996 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:23.994+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.001+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.045 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.043+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:15:24.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.124+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.155 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.153+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.169+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.221 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.219+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:15:24.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.305+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.328 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.326+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.335+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.367+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:15:24.418 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.417+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.432+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.442 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.440+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.470+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:15:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.548+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.581 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.579+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.596+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.643+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:15:24.721 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.719+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.744+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.757+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.812+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:15:24.866 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.865+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.883 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.881+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.889+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:24.935 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.933+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:15:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:24.996+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.023+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.036 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.035+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.107+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:15:25.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.164+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.186+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.197 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.195+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.233+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:15:25.305 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.303+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.322+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.330+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.384+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:15:25.478 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.477+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.503+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.516 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.514+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.567+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.626+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.656 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.654+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.668+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.719 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.717+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:15:25.799 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.797+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.825 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.823+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:25.845 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.844+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:25.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.896+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:15:25.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:25.965+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.014+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.024+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.064+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:15:26.139 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.137+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.162+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.175+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.225 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.223+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:15:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.266+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.282+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:26.292 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.290+0000 7fcbf7827ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:26.405 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.403+0000 7fcbf7827ec0 20 remove_watcher() i=0 2019-11-27T16:15:26.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.404+0000 7fcbf7827ec0 2 removed watcher, disabling cache 2019-11-27T16:15:26.473 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.471+0000 7fcbf7827ec0 20 remove_watcher() i=1 2019-11-27T16:15:26.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.522+0000 7fcbf7827ec0 20 remove_watcher() i=2 2019-11-27T16:15:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.602+0000 7fcbf7827ec0 20 remove_watcher() i=3 2019-11-27T16:15:26.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.644+0000 7fcbf7827ec0 20 remove_watcher() i=4 2019-11-27T16:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.682+0000 7fcbf7827ec0 20 remove_watcher() i=5 2019-11-27T16:15:26.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.740+0000 7fcbf7827ec0 20 remove_watcher() i=6 2019-11-27T16:15:26.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.777+0000 7fcbf7827ec0 20 remove_watcher() i=7 2019-11-27T16:15:26.791 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:15:26.924 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.922+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:26.945 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.943+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:26.945 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.943+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.955+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.955+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.960+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.960+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:26.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:26.969+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:27.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.161+0000 7f91f0d79ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:15:27.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.162+0000 7f91f0d79ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:15:27.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.162+0000 7f91f0d79ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:15:27.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.162+0000 7f91f0d79ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:15:27.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.162+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.173+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:27.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.173+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.188+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:27.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.188+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.201+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:27.203 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.201+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.222 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.220+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:27.222 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.220+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.228+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:27.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.228+0000 7f91f0d79ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:15:27.230 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.228+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.242 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.240+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:27.242 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.240+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.249+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:27.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.249+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.269+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:27.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.269+0000 7f91f0d79ec0 20 zonegroup default 2019-11-27T16:15:27.271 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.269+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.280 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.278+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:27.280 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.278+0000 7f91f0d79ec0 10 Cannot find current period zone using local zone 2019-11-27T16:15:27.280 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.278+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.288 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.286+0000 7f91f0d79ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:27.288 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.286+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.295+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:27.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.295+0000 7f91f0d79ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:27.318 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.317+0000 7f91f0d79ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:27.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.317+0000 7f91f0d79ec0 20 zone default found 2019-11-27T16:15:27.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.317+0000 7f91f0d79ec0 20 started sync module instance, tier type = 2019-11-27T16:15:27.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.317+0000 7f91f0d79ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:15:27.703 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=0 2019-11-27T16:15:27.703 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=1 2019-11-27T16:15:27.703 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=2 2019-11-27T16:15:27.703 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=3 2019-11-27T16:15:27.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=4 2019-11-27T16:15:27.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.701+0000 7f91f0d79ec0 20 add_watcher() i=5 2019-11-27T16:15:27.720 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.719+0000 7f91f0d79ec0 20 add_watcher() i=6 2019-11-27T16:15:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.735+0000 7f91f0d79ec0 20 add_watcher() i=7 2019-11-27T16:15:27.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.735+0000 7f91f0d79ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:15:27.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.735+0000 7f91ae7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:15:27.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.744+0000 7f91dd7a5700 0 -- 172.21.15.156:0/1415506471 >> v2:172.21.15.3:3300/0 conn(0x55c595f53a80 msgr2=0x55c595f55ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T16:15:27.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.946+0000 7f91dd7a5700 0 --2- 172.21.15.156:0/1415506471 >> v2:172.21.15.3:3300/0 conn(0x55c595f53a80 0x55c595f55ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T16:15:27.999 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:27.997+0000 7f91de7a7700 0 -- 172.21.15.156:0/3768897422 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7f9120017570 msgr2=0x7f9120019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:29.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.297+0000 7f9124ff9700 20 reqs_thread_entry: start 2019-11-27T16:15:29.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.297+0000 7f911e7fc700 20 reqs_thread_entry: start 2019-11-27T16:15:29.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.297+0000 7f91f0d79ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:15:29.300 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.297+0000 7f911cff9700 20 reqs_thread_entry: start 2019-11-27T16:15:29.300 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.297+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:15:29.373 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.371+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.394 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.392+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:29.404 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.402+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.452+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:15:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.501+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.517+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:29.528 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.526+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.558 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.556+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:15:29.609 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.607+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.627+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:29.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.637+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.684+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:15:29.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.745+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.764 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.762+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:29.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.771+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.820 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.818+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:15:29.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.888+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:29.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.918+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:29.936 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.935+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.000 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:29.998+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:15:30.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.057+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.086+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.102+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.139 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.137+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:15:30.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.198+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.224 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.222+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.235+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.276 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.275+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:15:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.321+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.339+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.357 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.355+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.388+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:15:30.432 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.430+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.447+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.456+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.495+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:15:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.574+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.612 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.611+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.633+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.700 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.698+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:15:30.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.771+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.802+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:30.821 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.819+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.882+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:15:30.961 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.959+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:30.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:30.987+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.003+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.050+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:15:31.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.122+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.155 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.154+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.169 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.168+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.226 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.224+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:15:31.280 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.278+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.293+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.303+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.341 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.339+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:15:31.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.398+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.417 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.416+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.426+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.490 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.488+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:15:31.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.562+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.592+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.603 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.601+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.645+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:15:31.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.716+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.736 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.734+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.744+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.811+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:15:31.886 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.884+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.909+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:31.923 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.921+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:31.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:31.985+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:15:32.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.045+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.066+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.078+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.129 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.127+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:15:32.192 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.191+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.233+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.251+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.315 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.313+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:15:32.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.370+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.408 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.406+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.417 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.415+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.462 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.460+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:15:32.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.523+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.538+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.547+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.595+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:15:32.648 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.646+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.666 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.664+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.675 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.673+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.709 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.707+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:15:32.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.744+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.762 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.760+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.768+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.812 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.810+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:15:32.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.852+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.867+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:32.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.875+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:32.909 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:32.907+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:15:33.006 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.004+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.041 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.039+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.053+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.110+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:15:33.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.174+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.197+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.211 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.209+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.258 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.257+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:15:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.306+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.323+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.333+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.370+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:15:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.504+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.531+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.548+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.594+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:15:33.641 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.639+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.656+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.663+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.698 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.697+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:15:33.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.755+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.768+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.778+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.826+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:15:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.886+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:33.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.919+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:33.935 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:33.934+0000 7f91f0d79ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.054+0000 7f91f0d79ec0 20 remove_watcher() i=0 2019-11-27T16:15:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.054+0000 7f91f0d79ec0 2 removed watcher, disabling cache 2019-11-27T16:15:34.093 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.091+0000 7f91f0d79ec0 20 remove_watcher() i=1 2019-11-27T16:15:34.127 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.125+0000 7f91f0d79ec0 20 remove_watcher() i=2 2019-11-27T16:15:34.209 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.207+0000 7f91f0d79ec0 20 remove_watcher() i=3 2019-11-27T16:15:34.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.262+0000 7f91f0d79ec0 20 remove_watcher() i=4 2019-11-27T16:15:34.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.307+0000 7f91f0d79ec0 20 remove_watcher() i=5 2019-11-27T16:15:34.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.353+0000 7f91f0d79ec0 20 remove_watcher() i=6 2019-11-27T16:15:34.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.400+0000 7f91f0d79ec0 20 remove_watcher() i=7 2019-11-27T16:15:34.411 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:15:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.522+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.550+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.550+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.561+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.561+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.567+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.569 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.567+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.576 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.574+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:34.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.820+0000 7f7eedfb1ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:15:34.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.820+0000 7f7eedfb1ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:15:34.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.820+0000 7f7eedfb1ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:15:34.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.820+0000 7f7eedfb1ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:15:34.823 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.820+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.831+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:34.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.831+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.853+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:34.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.853+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.868+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:34.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.868+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.890+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:34.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.891+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.901 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.899+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.901 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.899+0000 7f7eedfb1ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:15:34.901 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.899+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.911 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.909+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.911 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.909+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.918+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:34.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.918+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.939+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:34.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.939+0000 7f7eedfb1ec0 20 zonegroup default 2019-11-27T16:15:34.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.939+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.947+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.947+0000 7f7eedfb1ec0 10 Cannot find current period zone using local zone 2019-11-27T16:15:34.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.947+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.955+0000 7f7eedfb1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:34.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.955+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.970+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.970+0000 7f7eedfb1ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:34.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.988+0000 7f7eedfb1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:34.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.988+0000 7f7eedfb1ec0 20 zone default found 2019-11-27T16:15:34.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.988+0000 7f7eedfb1ec0 20 started sync module instance, tier type = 2019-11-27T16:15:34.990 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:34.988+0000 7f7eedfb1ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:15:35.438 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=0 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=1 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=2 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=3 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=4 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=5 2019-11-27T16:15:35.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.436+0000 7f7eedfb1ec0 20 add_watcher() i=6 2019-11-27T16:15:35.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.472+0000 7f7edb1de700 0 -- 172.21.15.156:0/3100769153 >> [v2:172.21.15.3:6824/9705,v1:172.21.15.3:6825/9705] conn(0x5611c06a96c0 msgr2=0x5611c06abae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:35.474 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.472+0000 7f7eedfb1ec0 20 add_watcher() i=7 2019-11-27T16:15:35.475 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.472+0000 7f7eedfb1ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:15:35.475 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.472+0000 7f7eab7e6700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:15:35.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.501+0000 7f7eda9dd700 0 -- 172.21.15.156:0/4252980567 >> v2:172.21.15.3:3300/0 conn(0x5611c06dc830 msgr2=0x5611c06dcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:35.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:35.703+0000 7f7eda9dd700 0 --2- 172.21.15.156:0/4252980567 >> v2:172.21.15.3:3300/0 conn(0x5611c06dc830 0x5611c06dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T16:15:37.245 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.243+0000 7f7e19ffb700 20 reqs_thread_entry: start 2019-11-27T16:15:37.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.243+0000 7f7e137fe700 20 reqs_thread_entry: start 2019-11-27T16:15:37.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.243+0000 7f7eedfb1ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:15:37.246 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.244+0000 7f7e11ffb700 20 reqs_thread_entry: start 2019-11-27T16:15:37.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.244+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:15:37.306 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.304+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.324+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.336+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.381+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:15:37.451 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.449+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.471 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.470+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:37.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.483+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.569+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:15:37.624 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.623+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.638+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:37.650 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.648+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.690+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:15:37.795 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.793+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.813+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:37.826 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.825+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:37.924 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.922+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:15:37.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:37.991+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.017 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.015+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.029 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.027+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.089+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:15:38.152 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.150+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.173 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.171+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.183 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.181+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.227+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:15:38.289 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.288+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.310+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.324 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.322+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.374 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.372+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:15:38.449 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.447+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.482 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.480+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.500+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.551+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:15:38.637 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.635+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.657+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.667+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.721 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.719+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:15:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.796+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.820+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.830+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.884 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.882+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:15:38.933 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.931+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.949+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:38.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.958+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:38.993+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:15:39.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.079+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.106+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.121+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.174 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.172+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:15:39.247 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.245+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.264+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.276 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.274+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.328+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:15:39.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.400+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.421+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.432+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.485+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:15:39.555 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.553+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.570+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.581+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.618+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:15:39.659 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.657+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.672+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.680+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.713+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:15:39.754 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.752+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.768+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.776+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.809 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.808+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:15:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.894+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.936+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:39.955 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:39.953+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.026 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.024+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:15:40.098 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.096+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.126+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.143+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.204+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:15:40.260 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.258+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.277 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.276+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.288 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.286+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.329 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.327+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:15:40.375 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.373+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.398+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.415+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.448 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.446+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:15:40.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.497+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.514 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.513+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.524 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.522+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.554 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.552+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:15:40.610 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.608+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.632+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.641+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.688 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.686+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:15:40.739 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.737+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.754+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.763+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.819 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.817+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:15:40.872 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.870+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.886+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:40.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.894+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:40.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.942+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:15:40.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:40.991+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.010 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.008+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.020 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.019+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.051 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.049+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:15:41.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.093+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.108+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.118 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.117+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.146+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:15:41.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.203+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.219 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.218+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.227+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.273 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.272+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:15:41.352 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.350+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.385 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.383+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.403 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.402+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.457 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.455+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:15:41.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.506+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.530 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.528+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.538+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.577 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.575+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:15:41.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.638+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.664 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.662+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.674+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.731 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.730+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:15:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.786+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.814 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.812+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:41.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.822+0000 7f7eedfb1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.925+0000 7f7eedfb1ec0 20 remove_watcher() i=0 2019-11-27T16:15:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.925+0000 7f7eedfb1ec0 2 removed watcher, disabling cache 2019-11-27T16:15:41.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:41.983+0000 7f7eedfb1ec0 20 remove_watcher() i=1 2019-11-27T16:15:42.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.059+0000 7f7eedfb1ec0 20 remove_watcher() i=2 2019-11-27T16:15:42.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.125+0000 7f7eedfb1ec0 20 remove_watcher() i=3 2019-11-27T16:15:42.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.160+0000 7f7eedfb1ec0 20 remove_watcher() i=4 2019-11-27T16:15:42.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.196+0000 7f7eedfb1ec0 20 remove_watcher() i=5 2019-11-27T16:15:42.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.233+0000 7f7eedfb1ec0 20 remove_watcher() i=6 2019-11-27T16:15:42.272 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.270+0000 7f7eedfb1ec0 20 remove_watcher() i=7 2019-11-27T16:15:42.279 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T16:15:42.380 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.378+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.405+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.405+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.416 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.415+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.417 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.415+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.421+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.422+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.430 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.429+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:42.688 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.686+0000 7ffa50e55ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T16:15:42.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.687+0000 7ffa50e55ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T16:15:42.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.687+0000 7ffa50e55ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T16:15:42.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.687+0000 7ffa50e55ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T16:15:42.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.687+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.710+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.710+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.730+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:42.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.730+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.740 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.739+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:42.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.739+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.758 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.757+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.757+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.765+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.765+0000 7ffa50e55ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T16:15:42.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.765+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.774+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.774+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.784 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.782+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:42.784 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.782+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.796 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.795+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T16:15:42.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.795+0000 7ffa50e55ec0 20 zonegroup default 2019-11-27T16:15:42.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.795+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.815+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.815+0000 7ffa50e55ec0 10 Cannot find current period zone using local zone 2019-11-27T16:15:42.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.815+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.833+0000 7ffa50e55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T16:15:42.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.833+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.844 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.843+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T16:15:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.843+0000 7ffa50e55ec0 20 rados->read ofs=0 len=0 2019-11-27T16:15:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.864+0000 7ffa50e55ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T16:15:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.864+0000 7ffa50e55ec0 20 zone default found 2019-11-27T16:15:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.864+0000 7ffa50e55ec0 20 started sync module instance, tier type = 2019-11-27T16:15:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:42.864+0000 7ffa50e55ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T16:15:43.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=0 2019-11-27T16:15:43.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=1 2019-11-27T16:15:43.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=2 2019-11-27T16:15:43.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=3 2019-11-27T16:15:43.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=4 2019-11-27T16:15:43.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=5 2019-11-27T16:15:43.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.265+0000 7ffa50e55ec0 20 add_watcher() i=6 2019-11-27T16:15:43.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.292+0000 7ffa50e55ec0 20 add_watcher() i=7 2019-11-27T16:15:43.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.292+0000 7ffa50e55ec0 2 all 8 watchers are set, enabling cache 2019-11-27T16:15:43.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.292+0000 7ffa0efdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T16:15:43.299 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.297+0000 7ffa35881700 0 -- 172.21.15.156:0/4049924983 >> v1:172.21.15.156:6789/0 conn(0x562c66f2b5e0 legacy=0x562c66f2da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:43.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:43.346+0000 7ffa35881700 0 -- 172.21.15.156:0/1289750529 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x562c66f3c420 msgr2=0x562c66f3e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T16:15:45.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.239+0000 7ff97d7fa700 20 reqs_thread_entry: start 2019-11-27T16:15:45.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.239+0000 7ff976ffd700 20 reqs_thread_entry: start 2019-11-27T16:15:45.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.239+0000 7ffa50e55ec0 20 init_complete bucket index max shards: 0 2019-11-27T16:15:45.242 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.240+0000 7ff9757fa700 20 reqs_thread_entry: start 2019-11-27T16:15:45.242 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.240+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T16:15:45.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.317+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.347 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.346+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.358+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.433 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.431+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T16:15:45.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.501+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.531 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.529+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.539+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.581 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.580+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T16:15:45.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.630+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.648 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.646+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:45.660 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.659+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.699 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.697+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T16:15:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.732+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.748 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.746+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.755+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:45.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:45.783+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T16:15:46.023 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.021+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.045 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.043+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.058+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.120+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T16:15:46.185 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.183+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.199+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.211 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.210+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.261+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T16:15:46.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.317+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.337+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.354 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.352+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.435 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.433+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T16:15:46.478 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.476+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.491+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.498+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.525+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T16:15:46.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.566+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.583 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.581+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.589+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.623 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.621+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T16:15:46.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.685+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.706 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.704+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.713+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:46.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:46.912+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T16:15:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.001+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.037+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.053+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.106+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T16:15:47.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.164+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.183 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.181+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.192+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.232+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T16:15:47.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.310+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.349 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.348+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.364 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.362+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.439 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.437+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T16:15:47.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.492+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.509+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.519+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.549+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T16:15:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.592+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.609 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.607+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.617 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.615+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.648 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.646+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T16:15:47.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.726+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.761 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.760+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.771+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.825 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.823+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T16:15:47.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.877+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.898 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.896+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:47.908 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.906+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:47.955 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:47.953+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T16:15:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.020+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.036+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.045+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.085+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T16:15:48.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.164+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.197+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.209+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.256+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T16:15:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.309+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.326 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.324+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.333+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.364+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T16:15:48.433 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.431+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.452+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.465 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.463+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.541 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.539+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T16:15:48.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.628+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.668+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.691 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.690+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.757 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.755+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T16:15:48.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.817+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.836+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:48.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.844+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:48.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.902+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T16:15:48.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:48.990+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.023+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.041 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.039+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.122+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T16:15:49.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.200+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.223 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.221+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.232+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.269 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.268+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T16:15:49.352 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.351+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.385+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.404+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.452+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T16:15:49.518 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.517+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.552+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.564+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.602 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.600+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T16:15:49.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.653+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.669+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.681+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.721 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.719+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T16:15:49.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.767+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.787 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.785+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.797 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.795+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.830+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T16:15:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.872+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.887+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.894+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.948+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T16:15:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:49.985+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.000+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:50.010 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.008+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.036+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T16:15:50.118 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.116+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:50.149 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.147+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T16:15:50.167 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.165+0000 7ffa50e55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T16:15:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.272+0000 7ffa50e55ec0 20 remove_watcher() i=0 2019-11-27T16:15:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.272+0000 7ffa50e55ec0 2 removed watcher, disabling cache 2019-11-27T16:15:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.324+0000 7ffa50e55ec0 20 remove_watcher() i=1 2019-11-27T16:15:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.373+0000 7ffa50e55ec0 20 remove_watcher() i=2 2019-11-27T16:15:50.442 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.440+0000 7ffa50e55ec0 20 remove_watcher() i=3 2019-11-27T16:15:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.484+0000 7ffa50e55ec0 20 remove_watcher() i=4 2019-11-27T16:15:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.526+0000 7ffa50e55ec0 20 remove_watcher() i=5 2019-11-27T16:15:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.579+0000 7ffa50e55ec0 20 remove_watcher() i=6 2019-11-27T16:15:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T16:15:50.625+0000 7ffa50e55ec0 20 remove_watcher() i=7 2019-11-27T16:15:50.636 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-27T16:15:51.248 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :clean 2019-11-27T16:15:51.845 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileJava 2019-11-27T16:15:51.845 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processResources 2019-11-27T16:15:51.846 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :classes 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :compileTestJava 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:52.047 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :processTestResources NO-SOURCE 2019-11-27T16:15:52.048 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :testClasses 2019-11-27T16:15:54.673 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:16:02.146 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.680 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:16:02.154 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.703 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:16:02.179 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.704 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:16:02.180 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.711 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:16:02.187 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.766 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:16:02.242 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.766 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:16:02.240 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:54.845 INFO:teuthology.orchestra.run.smithi156.stdout:> Task :test 2019-11-27T16:15:54.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:54.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-27T16:15:54.874 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:16:02.349 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:54.878 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:16:02.354 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:15:59.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:15:59.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-27T16:16:13.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:16:13.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-27T16:16:16.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:16:16.545 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-27T16:16:24.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:16:24.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-27T16:16:28.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:16:28.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-27T16:16:36.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:16:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-27T16:17:44.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:17:44.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-27T16:17:50.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:17:50.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-27T16:17:52.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:17:52.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-27T16:18:00.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:18:00.445 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-27T16:18:05.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:18:05.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-27T16:18:12.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:18:12.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-27T16:18:13.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:18:13.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-27T16:18:14.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:18:14.445 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-27T16:18:17.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.741 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-27T16:21:53.746 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:19:01.852 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.746 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:19:01.869 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.747 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:19:02.024 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.747 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.747 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-27T16:21:53.747 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.747 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-27T16:21:53.747 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.748 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.749 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-27T16:21:53.750 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.751 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-27T16:21:53.752 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.752 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-27T16:21:53.752 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:21:53.752 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-27T16:21:53.752 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:19:01.870 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.752 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:19:01.874 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.752 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:19:02.029 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.753 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:19:01.875 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.753 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:19:01.880 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:21:53.753 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:19:01.987 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.556 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:14.030 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.566 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:14.040 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.573 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:14.048 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.575 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:14.051 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.577 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:14.052 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.579 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:14.054 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.756 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:14.232 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.786 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:14.259 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:06.793 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:14.268 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.617 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:24.091 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.645 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:24.119 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.656 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:24.132 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.668 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:24.144 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.671 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:24:24.144 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.674 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:24.150 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.681 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:24.156 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.700 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:24:24.176 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:24:16.703 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:24:24.178 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:26:11.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:26:11.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-27T16:26:27.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:26:27.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-27T16:26:30.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:26:30.045 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-27T16:26:37.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:26:37.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-27T16:26:42.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:26:42.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-27T16:26:55.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.448 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-27T16:32:54.456 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:29:26.267 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.456 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:29:26.310 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.456 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:29:26.553 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.457 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:32:45.925 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.457 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:32:45.930 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.457 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:32:46.138 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.457 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.458 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-27T16:32:54.458 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.458 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-27T16:32:54.458 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.459 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-27T16:32:54.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.459 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-27T16:32:54.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.460 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-27T16:32:54.460 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.460 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-27T16:32:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.465 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-27T16:32:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.466 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-27T16:32:54.466 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.466 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-27T16:32:54.466 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:32:54.467 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-27T16:32:54.467 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T16:28:49.632+0000 d1f9b700 -1 handle_data failed with exit code -104 2019-11-27T16:32:54.467 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:29:26.285 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:29:26.288 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:29:26.462 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:32:45.933 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:32:45.950 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:32:46.034 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.468 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:29:26.285 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:29:26.292 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:29:26.460 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:32:45.952 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:32:45.978 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:32:54.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:32:46.066 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:34:30.600 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:34:38.073 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.685 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:34:38.108 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.685 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:34:38.114 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.685 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:34:38.218 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.685 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:34:38.114 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.686 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:34:38.122 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.686 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:34:38.206 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.686 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:39:02.686 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-27T16:39:02.686 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:39:02.686 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-27T16:39:02.686 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:39:02.687 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-27T16:39:02.687 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:34:38.107 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:02.687 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:34:38.270 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:39:05.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:39:05.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-27T16:39:43.714 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:39:51.188 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:39:51.210 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:39:51.217 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:39:51.413 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:39:51.216 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:39:51.222 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.124 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:39:51.439 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.125 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:28.125 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-27T16:40:28.125 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:28.125 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-27T16:40:28.125 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:39:51.204 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.125 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:39:51.444 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:40:28.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:28.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-27T16:40:46.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:46.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-27T16:40:47.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:47.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-27T16:40:49.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:49.546 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-27T16:40:52.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:40:52.045 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-27T16:41:00.348 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:41:07.822 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.354 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:41:07.828 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.388 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:41:07.863 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.390 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:41:07.865 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.391 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:41:07.866 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.393 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:41:07.869 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.430 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:41:07.905 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.444 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:41:07.919 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:00.537 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:41:08.011 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:41:14.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:41:18.739 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-27T16:41:21.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:41:21.145 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-27T16:41:40.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:41:40.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-27T16:41:47.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:41:47.946 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-27T16:42:21.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:42:25.489 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-27T16:42:26.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:42:26.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-27T16:42:56.116 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:43:03.590 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.181 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:43:03.605 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.182 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:43:03.609 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.182 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:43:03.599 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.182 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:43:03.658 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.183 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:43:03.659 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.209 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:43:03.685 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.235 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:43:03.709 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:56.266 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:43:03.741 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:42:57.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:42:57.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-27T16:43:01.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:43:01.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-27T16:43:42.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:43:42.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-27T16:43:50.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:43:50.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-27T16:44:52.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:44:52.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-27T16:44:53.964 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:45:01.438 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:53.977 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:45:01.451 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:53.979 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:45:01.455 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:53.981 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:45:01.456 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:53.984 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:45:01.460 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:53.986 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:45:01.461 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:54.070 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:45:01.546 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:54.086 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:45:01.562 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:44:54.096 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:45:01.570 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:45:01.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:45:01.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-27T16:46:21.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:46:21.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-27T16:47:22.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:47:22.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-27T16:49:22.552 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:49:30.026 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.556 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:49:30.030 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.607 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:49:30.083 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.620 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:49:30.095 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.626 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:49:30.102 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.635 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:49:30.110 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.701 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:49:30.175 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.814 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:49:30.290 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:22.834 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:49:30.310 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:49:38.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:49:42.237 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-27T16:50:03.876 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:50:11.349 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.886 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:50:11.360 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.890 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:50:11.366 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.893 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:50:11.369 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.896 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:50:11.372 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.902 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:50:11.377 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.950 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:50:11.425 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.968 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:50:11.443 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:50:03.994 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:50:11.468 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:51:18.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:51:18.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-27T16:54:31.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:54:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-27T16:55:17.261 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:55:24.735 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.268 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:55:24.742 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.273 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:55:24.748 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.275 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:55:24.751 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.279 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:55:24.754 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.284 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:55:24.759 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.446 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:55:24.922 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.447 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:55:24.922 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:17.531 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:55:25.005 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:55:53.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:55:53.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-27T16:57:44.552 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:57:52.025 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.558 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:57:52.032 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.621 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:57:52.096 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.623 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:57:52.098 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.624 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:57:52.100 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.625 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:57:52.101 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.681 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:01:57:52.155 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.691 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:01:57:52.166 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T16:57:44.741 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:01:57:52.216 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T16:59:31.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T16:59:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-27T17:00:25.329 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:00:32.803 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.342 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:00:32.816 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.349 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:00:32.825 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.351 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:00:32.827 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.353 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:00:32.828 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.355 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:00:32.831 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.460 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:00:32.935 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.463 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:00:32.938 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:00:25.478 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:00:32.951 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:01:45.350 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:01:45.350 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-27T17:05:39.533 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:05:47.007 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.542 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:05:47.016 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.546 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:05:47.021 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.549 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:05:47.024 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.557 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:05:47.032 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.559 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:05:47.035 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.731 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:05:47.206 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.748 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:05:47.223 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:05:39.872 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:05:47.346 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.468 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:06:13.941 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.513 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:06:13.987 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.556 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:06:14.029 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.565 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:06:14.040 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.577 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:06:14.052 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.593 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:06:14.068 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.598 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:06:14.074 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.616 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:06:14.091 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:06.637 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:06:14.112 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:06:11.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:06:11.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-27T17:08:37.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:08:37.246 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-27T17:10:47.676 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:10:55.149 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.687 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:10:55.160 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.691 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:10:55.165 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.695 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:10:55.170 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.695 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:10:55.170 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.698 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:10:55.174 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.845 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:10:55.320 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.868 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:10:55.343 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:10:47.971 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:10:55.445 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:11:19.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:11:19.446 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-27T17:12:32.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:12:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-27T17:14:28.273 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:14:35.747 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.282 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:14:35.756 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.287 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:14:35.762 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.301 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:14:35.776 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.336 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:14:35.811 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.339 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:14:35.814 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.412 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:14:35.887 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.419 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:14:35.892 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:14:28.443 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:14:35.918 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:07.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:15:07.646 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-27T17:15:58.806 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:16:06.280 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.819 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:16:06.293 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.821 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:16:06.296 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.824 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:16:06.299 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.826 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:16:06.302 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.831 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:16:06.306 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.918 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:16:06.391 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.927 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:16:06.402 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:15:58.928 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:16:06.404 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:16:29.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:16:29.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-27T17:17:51.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:17:51.846 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-27T17:18:28.846 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:18:38.196 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-27T17:19:07.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:19:07.246 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-27T17:19:16.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:19:16.045 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-27T17:19:29.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:19:29.145 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-27T17:19:37.446 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:19:37.446 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-27T17:19:52.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:19:52.046 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-27T17:20:01.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:01.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-27T17:20:15.947 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:15.947 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-27T17:20:24.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:24.346 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-27T17:20:34.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:34.346 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-27T17:20:40.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:40.545 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-27T17:20:52.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:20:52.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-27T17:21:02.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:21:02.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-27T17:21:13.456 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:21:20.929 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.467 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:21:20.940 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.468 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:21:20.942 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.468 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:21:20.942 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.475 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:21:20.950 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.477 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:21:20.952 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.676 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:21:21.151 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.681 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:21:21.156 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:13.741 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:21:21.214 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:21:17.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:21:17.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-27T17:21:25.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:21:25.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-27T17:21:39.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:21:39.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-27T17:21:48.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:21:48.546 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-27T17:22:01.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:01.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-27T17:22:10.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:10.446 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-27T17:22:21.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:21.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-27T17:22:28.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:28.546 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-27T17:22:39.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:39.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-27T17:22:46.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:46.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-27T17:22:50.355 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:22:57.828 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.361 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:22:57.834 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.385 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:22:57.860 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.388 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:22:57.863 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.403 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:22:57.879 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.409 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:22:57.885 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.457 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:22:57.932 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.462 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:22:57.936 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:50.464 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:22:57.940 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:22:57.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:22:57.746 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-27T17:23:03.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:03.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-27T17:23:15.879 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:23:23.352 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.886 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:23:23.360 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.908 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:23:23.383 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.912 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:23:23.385 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.926 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:23:23.399 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.938 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:23:23.410 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.938 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:23:23.413 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.949 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:23:23.424 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:15.965 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:23:23.440 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:23:16.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:16.145 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-27T17:23:22.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:22.645 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-27T17:23:33.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-27T17:23:39.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:39.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-27T17:23:50.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:50.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-27T17:23:53.245 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:53.245 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-27T17:23:58.845 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:23:58.845 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-27T17:24:02.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:02.446 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-27T17:24:10.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:10.145 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-27T17:24:13.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:13.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-27T17:24:23.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:23.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-27T17:24:27.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-27T17:24:54.934 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-27T17:24:54.934 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-27T17:24:54.935 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-27T17:24:54.935 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-27T17:24:54.936 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-27T17:24:58.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:24:58.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-27T17:25:07.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:07.046 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-27T17:25:12.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:12.046 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-27T17:25:20.345 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:20.345 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-27T17:25:23.445 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:23.445 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-27T17:25:29.745 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:29.745 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-27T17:25:32.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-27T17:25:39.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:39.146 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-27T17:25:44.145 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:58.431 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-27T17:25:58.432 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:25:58.433 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-27T17:26:23.570 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:26:31.043 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.580 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:26:31.055 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.580 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:26:31.053 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.582 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:26:31.057 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.583 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:26:31.059 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.589 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:26:31.065 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.697 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:26:31.172 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.703 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:26:31.179 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:23.715 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:26:31.188 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:26:34.545 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:26:34.545 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-27T17:26:43.045 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:26:43.045 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-27T17:27:22.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:27:22.945 INFO:teuthology.orchestra.run.smithi156.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-27T17:27:33.787 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:27:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:---------------------------------------------------------------------- 2019-11-27T17:27:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-27T17:27:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:---------------------------------------------------------------------- 2019-11-27T17:27:33.788 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:27:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:BUILD SUCCESSFUL in 1h 11m 43s 2019-11-27T17:27:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:5 actionable tasks: 5 executed 2019-11-27T17:27:33.802 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T17:27:33.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.939+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.965+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:33.968 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.965+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:33.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.977+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:33.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.977+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:33.985 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.983+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:33.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.983+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:33.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:33.991+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.270+0000 7fdb5eee5ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:27:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.270+0000 7fdb5eee5ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:27:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.270+0000 7fdb5eee5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:27:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.270+0000 7fdb5eee5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:27:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.270+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.280+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:34.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.281+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.301+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.301+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.314+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:34.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.314+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.334 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.332+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:34.334 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.332+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.343+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:34.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.343+0000 7fdb5eee5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:27:34.345 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.343+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.353+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:34.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.353+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.365+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:34.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.365+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.384+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:34.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.384+0000 7fdb5eee5ec0 20 zonegroup default 2019-11-27T17:27:34.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.384+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.394+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:34.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.394+0000 7fdb5eee5ec0 10 Cannot find current period zone using local zone 2019-11-27T17:27:34.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.394+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.404 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.402+0000 7fdb5eee5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:34.404 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.402+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.415 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.412+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:34.415 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.412+0000 7fdb5eee5ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:34.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.432+0000 7fdb5eee5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:34.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.432+0000 7fdb5eee5ec0 20 zone default found 2019-11-27T17:27:34.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.432+0000 7fdb5eee5ec0 20 started sync module instance, tier type = 2019-11-27T17:27:34.434 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.432+0000 7fdb5eee5ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:27:34.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=0 2019-11-27T17:27:34.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=1 2019-11-27T17:27:34.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=2 2019-11-27T17:27:34.874 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=3 2019-11-27T17:27:34.874 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=4 2019-11-27T17:27:34.874 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.871+0000 7fdb5eee5ec0 20 add_watcher() i=5 2019-11-27T17:27:34.902 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.900+0000 7fdb5eee5ec0 20 add_watcher() i=6 2019-11-27T17:27:34.911 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.909+0000 7fdb5eee5ec0 20 add_watcher() i=7 2019-11-27T17:27:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.909+0000 7fdb5eee5ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:27:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.909+0000 7fdb1cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:27:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.910+0000 7fdb43fff700 0 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55a52e407bb0 msgr2=0x55a52e407fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T17:27:34.954 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:34.952+0000 7fdb4c913700 0 -- 172.21.15.156:0/615226433 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7fda90017570 msgr2=0x7fda90019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T17:27:36.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.497+0000 7fda8effd700 20 reqs_thread_entry: start 2019-11-27T17:27:36.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.497+0000 7fda8cff9700 20 reqs_thread_entry: start 2019-11-27T17:27:36.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.497+0000 7fdb5eee5ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:27:36.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.497+0000 7fda82ffd700 20 reqs_thread_entry: start 2019-11-27T17:27:36.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.497+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T17:27:36.575 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.573+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.604 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.601+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:36.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.613+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.672+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T17:27:36.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.738+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.764+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.776+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.830 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.827+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T17:27:36.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.883+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.903+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:36.919 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.917+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:36.952+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T17:27:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.015+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.031+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:37.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:37.060 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ', time=2019-11-27T18:40:41.454817+0000, chain.objs.size()=31 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.1 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.2 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.3 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.4 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.5 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.6 2019-11-27T17:27:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.7 2019-11-27T17:27:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.8 2019-11-27T17:27:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.9 2019-11-27T17:27:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.10 2019-11-27T17:27:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.11 2019-11-27T17:27:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.057+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.12 2019-11-27T17:27:37.214 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.212+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.13 2019-11-27T17:27:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.225+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.14 2019-11-27T17:27:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.225+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.dDlWBaBhf6XDYYqOKnDes9tdIJ6PevZ.15 2019-11-27T17:27:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.R0CxwpbxJmz_3JeJjO5tzUA7jO3a2No.16 2019-11-27T17:27:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.vl_3rNEsm7wDOdAmfYvvlMsJhzg-FO3.17 2019-11-27T17:27:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.iF3WmM-0iuUSP0DFjP0Npgj76E0LX12.18 2019-11-27T17:27:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.jmQvXBgmoZiHtlWdcOo7NtdPD5cjXH4.19 2019-11-27T17:27:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.TjYwZ7j3rfMPgy4Z1fptKaIyatrDYyk.20 2019-11-27T17:27:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.21 2019-11-27T17:27:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.22 2019-11-27T17:27:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.234+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.23 2019-11-27T17:27:37.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.279+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.24 2019-11-27T17:27:37.286 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.284+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.25 2019-11-27T17:27:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.376+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.26 2019-11-27T17:27:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.376+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.27 2019-11-27T17:27:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.376+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.28 2019-11-27T17:27:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.377+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.29 2019-11-27T17:27:37.380 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.377+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.30 2019-11-27T17:27:37.380 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.377+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.78__multipart_key1.2~qaTDon1Iu6SbPxrPZlOoeacYQ37dUWZ.31 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.2176', time=2019-11-27T19:26:36.771105+0000, chain.objs.size()=9 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__multipart_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.1 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__shadow_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.1_1 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__multipart_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.2 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__shadow_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.2_1 2019-11-27T17:27:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.378+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__multipart_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.3 2019-11-27T17:27:37.468 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.466+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__shadow_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.3_1 2019-11-27T17:27:37.492 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.490+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__multipart_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.4 2019-11-27T17:27:37.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.543+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__shadow_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.4_1 2019-11-27T17:27:37.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.543+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.118__multipart_key1.2~Q3dPSaB5lJQo5TrDeAasfrvJ0AVKZnX.5 2019-11-27T17:27:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.685+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:37.835 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.833+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T17:27:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.907+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:37.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.929+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:37.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.938+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:37.988 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:37.985+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T17:27:38.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.025+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:38.043 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.040+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:38.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:38.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1167', time=2019-11-27T18:26:22.031655+0000, chain.objs.size()=5 2019-11-27T17:27:38.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.66__shadow_.H6QmE2g0JdSPEIjs5TcAcyutHahK4v1_1 2019-11-27T17:27:38.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.66__shadow_.H6QmE2g0JdSPEIjs5TcAcyutHahK4v1_2 2019-11-27T17:27:38.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.66__shadow_.H6QmE2g0JdSPEIjs5TcAcyutHahK4v1_3 2019-11-27T17:27:38.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.66__shadow_.H6QmE2g0JdSPEIjs5TcAcyutHahK4v1_4 2019-11-27T17:27:38.057 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.052+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.66__shadow_.H6QmE2g0JdSPEIjs5TcAcyutHahK4v1_5 2019-11-27T17:27:38.347 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.344+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:38.476 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.474+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T17:27:38.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.548+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.574+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:38.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:38.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1175', time=2019-11-27T18:23:48.675095+0000, chain.objs.size()=9 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.1 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.1_1 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.2 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.2_1 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.3 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.3_1 2019-11-27T17:27:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.4 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.4_1 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~k9w0B4irQY7pLR6iroCn3namn6kJZCe.5 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1334', time=2019-11-27T18:35:26.570304+0000, chain.objs.size()=9 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.1 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.1_1 2019-11-27T17:27:38.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.612+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.2 2019-11-27T17:27:38.805 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.803+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.2_1 2019-11-27T17:27:38.805 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:38.803+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.3 2019-11-27T17:27:39.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.100+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.3_1 2019-11-27T17:27:39.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.100+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.4 2019-11-27T17:27:39.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.101+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.4_1 2019-11-27T17:27:39.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.101+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~8Rraldmk_WTxS0xS4gxghVxZaZ3GqhP.5 2019-11-27T17:27:39.290 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.288+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:39.422 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.419+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T17:27:39.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.483+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:39.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.503+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:39.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:39.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1080', time=2019-11-27T18:19:07.073083+0000, chain.objs.size()=2 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.56__shadow_.s4mExuu-odYkP6UkyUY5_FIT0QS49KA_1 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.56__shadow_.s4mExuu-odYkP6UkyUY5_FIT0QS49KA_2 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1344', time=2019-11-27T18:37:15.158137+0000, chain.objs.size()=7 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.1 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.1_1 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.1_2 2019-11-27T17:27:39.521 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.2 2019-11-27T17:27:39.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.2_1 2019-11-27T17:27:39.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.517+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.2_2 2019-11-27T17:27:39.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.518+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~dZIPEaa9VLDHS11Ywr8A-N1LcFy2ktV.3 2019-11-27T17:27:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:39.939+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.064+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T17:27:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.137+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:40.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.165+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:40.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:40.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1197', time=2019-11-27T18:25:39.282833+0000, chain.objs.size()=7 2019-11-27T17:27:40.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.1 2019-11-27T17:27:40.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.1_1 2019-11-27T17:27:40.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.1_2 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.2 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.2_1 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.2_2 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~erJF12_gxn8C3qURnQ1CyaF5yrYDdZA.3 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1246', time=2019-11-27T18:27:39.579014+0000, chain.objs.size()=9 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__multipart_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.1 2019-11-27T17:27:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__shadow_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.1_1 2019-11-27T17:27:40.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__multipart_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.2 2019-11-27T17:27:40.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__shadow_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.2_1 2019-11-27T17:27:40.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.195+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__multipart_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.3 2019-11-27T17:27:40.447 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.444+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__shadow_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.3_1 2019-11-27T17:27:40.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.516+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__multipart_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.4 2019-11-27T17:27:40.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.516+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__shadow_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.4_1 2019-11-27T17:27:40.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.516+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.71__multipart_key1.2~fN4YEjMXCPCqoajdP0El3IXYWRPkAv9.5 2019-11-27T17:27:40.693 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.691+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:40.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.837+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T17:27:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.891+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:40.911 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.908+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:40.924 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.921+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:40.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:40.984+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T17:27:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.068+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:41.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.098+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:41.122 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1320', time=2019-11-27T18:33:21.338607+0000, chain.objs.size()=9 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.1 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.1_1 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.2 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.119+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.2_1 2019-11-27T17:27:41.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.120+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.3 2019-11-27T17:27:41.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.120+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.3_1 2019-11-27T17:27:41.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.120+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.4 2019-11-27T17:27:41.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.120+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.4_1 2019-11-27T17:27:41.124 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.120+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~vmOa-8o2PuFyFWTki0GjKdvUgX1j8MP.5 2019-11-27T17:27:41.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.492+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.570+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T17:27:41.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.613+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:41.631 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.629+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:41.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.638+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.672+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T17:27:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.709+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:41.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.725+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1183', time=2019-11-27T18:24:24.323217+0000, chain.objs.size()=9 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.1 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.1_1 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.2 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.2_1 2019-11-27T17:27:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.3 2019-11-27T17:27:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.3_1 2019-11-27T17:27:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.4 2019-11-27T17:27:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.4_1 2019-11-27T17:27:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:41.740+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~405rxzs3TsqcAn56M8SIokKtY1bbLo9.5 2019-11-27T17:27:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.368+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:42.457 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.455+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T17:27:42.503 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.500+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:42.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.523+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:42.543 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.540+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:42.543 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.540+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5', time=2019-11-27T18:31:15.120853+0000, chain.objs.size()=9 2019-11-27T17:27:42.543 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.540+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__multipart_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.7 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.540+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__shadow_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.7_1 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__multipart_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.8 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__shadow_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.8_1 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__multipart_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.9 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__shadow_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.9_1 2019-11-27T17:27:42.544 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__multipart_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.10 2019-11-27T17:27:42.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__shadow_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.10_1 2019-11-27T17:27:42.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.541+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.74__multipart_key1.2~2ObM7x3NzT7e5fYXFP7DS-9-h0mXbw5.11 2019-11-27T17:27:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.863+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:42.973+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T17:27:43.048 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.046+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:43.071 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.069+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1364', time=2019-11-27T18:39:00.638153+0000, chain.objs.size()=9 2019-11-27T17:27:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__multipart_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.1 2019-11-27T17:27:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__shadow_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.1_1 2019-11-27T17:27:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__multipart_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.2 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__shadow_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.2_1 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__multipart_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.3 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__shadow_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.3_1 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__multipart_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.4 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__shadow_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.4_1 2019-11-27T17:27:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.087+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.76__multipart_key1.2~NSNr2RpjsyozjymwQ_w6PTLAsYmT-0I.5 2019-11-27T17:27:43.302 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.300+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.397+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T17:27:43.450 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.448+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.467+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:43.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:43.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1209', time=2019-11-27T18:26:14.341046+0000, chain.objs.size()=7 2019-11-27T17:27:43.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.1 2019-11-27T17:27:43.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.1_1 2019-11-27T17:27:43.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.1_2 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.2 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.2_1 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.2_2 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~fB-1MB_cO6UjmymLI0icVtPkqBBDIZr.3 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.2192', time=2019-11-27T19:27:25.732701+0000, chain.objs.size()=9 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__multipart_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.1 2019-11-27T17:27:43.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__shadow_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.1_1 2019-11-27T17:27:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__multipart_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.2 2019-11-27T17:27:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__shadow_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.2_1 2019-11-27T17:27:43.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.494+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__multipart_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.3 2019-11-27T17:27:43.877 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.871+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__shadow_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.3_1 2019-11-27T17:27:43.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.877+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__multipart_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.4 2019-11-27T17:27:43.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.877+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__shadow_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.4_1 2019-11-27T17:27:43.879 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:43.877+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.119__multipart_key1/data/file.mpg.2~9eHeX4Gg3dXdK63ATrfNrqxDli_su1K.5 2019-11-27T17:27:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.072+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:44.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.162+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T17:27:44.213 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.210+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:44.235 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.232+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:44.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:44.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1327', time=2019-11-27T18:34:16.310511+0000, chain.objs.size()=9 2019-11-27T17:27:44.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.1 2019-11-27T17:27:44.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.1_1 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.2 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.2_1 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.3 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.3_1 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.4 2019-11-27T17:27:44.254 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.4_1 2019-11-27T17:27:44.255 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.250+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~EoIlIpXFUfPfziCxxbVIRvGc562L_DL.5 2019-11-27T17:27:44.658 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.655+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:44.773 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.770+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T17:27:44.819 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.817+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:44.836 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.834+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:44.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:44.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~i0E0CgVIIG889GEyy4NCCE775zygjja', time=2019-11-27T18:17:43.558897+0000, chain.objs.size()=9 2019-11-27T17:27:44.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__multipart_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.1 2019-11-27T17:27:44.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__shadow_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.1_1 2019-11-27T17:27:44.854 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__multipart_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.2 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__shadow_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.2_1 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__multipart_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.3 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__shadow_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.3_1 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__multipart_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.4 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__shadow_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.4_1 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.52__multipart_key1.2~i0E0CgVIIG889GEyy4NCCE775zygjja.5 2019-11-27T17:27:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1339', time=2019-11-27T18:36:20.689609+0000, chain.objs.size()=7 2019-11-27T17:27:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.1 2019-11-27T17:27:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.1_1 2019-11-27T17:27:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:44.851+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.1_2 2019-11-27T17:27:45.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.100+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.2 2019-11-27T17:27:45.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.100+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.2_1 2019-11-27T17:27:45.232 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.230+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.2_2 2019-11-27T17:27:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.293+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~cxsgBSJGWTXksJqLxoxMSV0EfE7QFZG.3 2019-11-27T17:27:45.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.411+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:45.491 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.489+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T17:27:45.549 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.547+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:45.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.565+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:45.589 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-27T17:27:45.589 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1191', time=2019-11-27T18:24:50.657748+0000, chain.objs.size()=9 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.1 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.1_1 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.2 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.2_1 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.3 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.3_1 2019-11-27T17:27:45.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.4 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.4_1 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~tjHLPs0T8mlIx2J1FPHG9pHt5bQhpF_.5 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1349', time=2019-11-27T18:37:18.919035+0000, chain.objs.size()=7 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.1 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.1_1 2019-11-27T17:27:45.591 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.586+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.1_2 2019-11-27T17:27:45.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.946+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.2 2019-11-27T17:27:45.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.946+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.2_1 2019-11-27T17:27:45.949 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:45.946+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__shadow_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.2_2 2019-11-27T17:27:46.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.022+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.75__multipart_key1.2~9i71IDatykqUQ_3SFHw6alRQ_cGzF5M.3 2019-11-27T17:27:46.157 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.155+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:46.296 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.290+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T17:27:46.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.327+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:46.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.341+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:46.352 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.350+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:46.405 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.402+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T17:27:46.459 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.457+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:46.477 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.475+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:46.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-27T17:27:46.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1154', time=2019-11-27T18:21:23.969542+0000, chain.objs.size()=9 2019-11-27T17:27:46.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.1 2019-11-27T17:27:46.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.1_1 2019-11-27T17:27:46.499 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.2 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.2_1 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.3 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.3_1 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.4 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.4_1 2019-11-27T17:27:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.5 2019-11-27T17:27:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1152', time=2019-11-27T18:21:30.165037+0000, chain.objs.size()=9 2019-11-27T17:27:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.1 2019-11-27T17:27:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.1_1 2019-11-27T17:27:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.496+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.2 2019-11-27T17:27:46.642 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.640+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.2_1 2019-11-27T17:27:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.3 2019-11-27T17:27:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.3_1 2019-11-27T17:27:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.4 2019-11-27T17:27:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__shadow_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.4_1 2019-11-27T17:27:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.64__multipart_key1.2~0cIXjek0I_yr4CNjh9vMZtxoPS8GHfr.5 2019-11-27T17:27:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1203', time=2019-11-27T18:26:10.185997+0000, chain.objs.size()=7 2019-11-27T17:27:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.742+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.1 2019-11-27T17:27:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.743+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.1_1 2019-11-27T17:27:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.743+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.1_2 2019-11-27T17:27:46.840 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.838+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.2 2019-11-27T17:27:46.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.961+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.2_1 2019-11-27T17:27:46.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.961+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__shadow_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.2_2 2019-11-27T17:27:46.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:46.961+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.67__multipart_key1.2~RfNKBoApzWLER3wfphz5rmbV33-NGPn.3 2019-11-27T17:27:47.298 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.296+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:47.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.441+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T17:27:47.491 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.489+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.508 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.505+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:47.515 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.513+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.555 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.552+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T17:27:47.593 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.590+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.611 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.608+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:47.619 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.617+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.650 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.648+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T17:27:47.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.687+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.703+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:47.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.711+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.745 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.743+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T17:27:47.799 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.797+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.816 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.814+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:47.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.826+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.872 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.869+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T17:27:47.938 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.935+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:47.969 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.967+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:47.987 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:47.981+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:48.031 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.029+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T17:27:48.079 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.076+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:48.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.093+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:48.109 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1379', time=2019-11-27T18:40:08.996305+0000, chain.objs.size()=9 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__multipart_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.1 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__shadow_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.1_1 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__multipart_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.2 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__shadow_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.2_1 2019-11-27T17:27:48.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__multipart_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.3 2019-11-27T17:27:48.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__shadow_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.3_1 2019-11-27T17:27:48.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__multipart_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.4 2019-11-27T17:27:48.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__shadow_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.4_1 2019-11-27T17:27:48.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.107+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.77__multipart_key1.2~vzQwkGnZC6geY0qu4a8nMQ6RXxEpceq.5 2019-11-27T17:27:48.425 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.423+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.521+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T17:27:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.589+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:48.622 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.619+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:48.639 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.631+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:48.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.684+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T17:27:48.764 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.762+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:48.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.783+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:48.799 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1290', time=2019-11-27T18:30:00.247688+0000, chain.objs.size()=9 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__multipart_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.1 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__shadow_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.1_1 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__multipart_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.2 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__shadow_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.2_1 2019-11-27T17:27:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__multipart_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.3 2019-11-27T17:27:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__shadow_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.3_1 2019-11-27T17:27:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__multipart_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.4 2019-11-27T17:27:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__shadow_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.4_1 2019-11-27T17:27:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:48.797+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.73__multipart_file.mpg.2~viTR0YzFSp4aeBDcFzWmG_e_F8UH3SD.5 2019-11-27T17:27:49.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.053+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:49.144 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.141+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T17:27:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.182+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.198+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:49.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.206+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:49.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.239+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T17:27:49.332 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.329+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:49.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.366+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:49.384 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.382+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:49.452 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.450+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T17:27:49.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.520+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.554+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 20 garbage collection: RGWGC::process iterating over entry tag='52e9f6d5-9017-4df2-9490-35fe7d8cf870.4537.1265', time=2019-11-27T18:28:53.039184+0000, chain.objs.size()=9 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__multipart_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.1 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__shadow_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.1_1 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__multipart_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.2 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__shadow_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.2_1 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__multipart_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.3 2019-11-27T17:27:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__shadow_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.3_1 2019-11-27T17:27:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__multipart_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.4 2019-11-27T17:27:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__shadow_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.4_1 2019-11-27T17:27:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.582+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.72__multipart_key1.2~Do4VWOGdhXyHG8TRYLvIWgIw-VlAQEN.5 2019-11-27T17:27:49.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:49.873+0000 7fdb5eee5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-27T17:27:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.001+0000 7fdb5eee5ec0 20 remove_watcher() i=0 2019-11-27T17:27:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.001+0000 7fdb5eee5ec0 2 removed watcher, disabling cache 2019-11-27T17:27:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.043+0000 7fdb5eee5ec0 20 remove_watcher() i=1 2019-11-27T17:27:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.073+0000 7fdb5eee5ec0 20 remove_watcher() i=2 2019-11-27T17:27:50.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.120+0000 7fdb5eee5ec0 20 remove_watcher() i=3 2019-11-27T17:27:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.157+0000 7fdb5eee5ec0 20 remove_watcher() i=4 2019-11-27T17:27:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.207+0000 7fdb5eee5ec0 20 remove_watcher() i=5 2019-11-27T17:27:50.263 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.260+0000 7fdb5eee5ec0 20 remove_watcher() i=6 2019-11-27T17:27:50.315 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.313+0000 7fdb5eee5ec0 20 remove_watcher() i=7 2019-11-27T17:27:50.327 INFO:teuthology.orchestra.run.smithi156:> radosgw-admin gc process --include-all 2019-11-27T17:27:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.456+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.478+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.478+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.490+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.490+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.496+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.496+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.503+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:50.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.749+0000 7ffa7a76eec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:27:50.752 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.749+0000 7ffa7a76eec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:27:50.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.749+0000 7ffa7a76eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:27:50.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.749+0000 7ffa7a76eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:27:50.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.749+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.761 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.759+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:50.761 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.759+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.776+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:50.779 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.776+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.789+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.789+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.804+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.804+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.813+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.813+0000 7ffa7a76eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:27:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.813+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.822+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.822+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.831 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.829+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.829+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.848+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.848+0000 7ffa7a76eec0 20 zonegroup default 2019-11-27T17:27:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.848+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.856+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.856+0000 7ffa7a76eec0 10 Cannot find current period zone using local zone 2019-11-27T17:27:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.856+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.861+0000 7ffa7a76eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:50.864 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.861+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.872+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.872+0000 7ffa7a76eec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.887+0000 7ffa7a76eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.887+0000 7ffa7a76eec0 20 zone default found 2019-11-27T17:27:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.887+0000 7ffa7a76eec0 20 started sync module instance, tier type = 2019-11-27T17:27:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:50.887+0000 7ffa7a76eec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:27:51.370 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=0 2019-11-27T17:27:51.370 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=1 2019-11-27T17:27:51.370 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=2 2019-11-27T17:27:51.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=3 2019-11-27T17:27:51.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=4 2019-11-27T17:27:51.371 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.368+0000 7ffa7a76eec0 20 add_watcher() i=5 2019-11-27T17:27:51.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.377+0000 7ffa7a76eec0 20 add_watcher() i=6 2019-11-27T17:27:51.431 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.429+0000 7ffa7a76eec0 20 add_watcher() i=7 2019-11-27T17:27:51.431 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.429+0000 7ffa7a76eec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:27:51.431 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.429+0000 7ff9bbfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:27:51.438 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.436+0000 7ffa6799b700 0 -- 172.21.15.156:0/2366924831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x556800ae8230 msgr2=0x556800ad1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T17:27:51.640 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.638+0000 7ffa6799b700 0 --2- 172.21.15.156:0/2366924831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x556800ae8230 0x556800ad1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T17:27:51.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:51.773+0000 7ffa6819c700 0 -- 172.21.15.156:0/2587931986 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7ff9a801f9d0 msgr2=0x7ff9a8021ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T17:27:53.413 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.411+0000 7ff9a67fc700 20 reqs_thread_entry: start 2019-11-27T17:27:53.414 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.411+0000 7ff9a4ff9700 20 reqs_thread_entry: start 2019-11-27T17:27:53.414 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.411+0000 7ffa7a76eec0 20 init_complete bucket index max shards: 0 2019-11-27T17:27:53.414 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.412+0000 7ff99effd700 20 reqs_thread_entry: start 2019-11-27T17:27:53.415 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.412+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-27T17:27:53.455 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.453+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.472 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.470+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:53.480 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.478+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.510+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-27T17:27:53.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.582+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.612+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:53.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.632+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.702+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-27T17:27:53.772 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.770+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.811 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.809+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:53.821 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.819+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.873 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.871+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-27T17:27:53.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.958+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:53.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:53.990+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.006 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.004+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.080+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-27T17:27:54.184 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.182+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.206 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.204+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.218 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.215+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.247+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-27T17:27:54.294 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.291+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.309 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.306+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.317 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.315+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.346+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-27T17:27:54.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.407+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.422+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.432 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.430+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.470 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.468+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-27T17:27:54.519 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.517+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.534 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.532+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.542 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.540+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.582+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-27T17:27:54.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.627+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.642+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.652 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.650+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.695 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.693+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-27T17:27:54.736 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.733+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.750 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.748+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.765+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.798 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.796+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-27T17:27:54.851 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.849+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.867+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.878 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.875+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.916 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.914+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-27T17:27:54.970 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.967+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:54.984 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.982+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:54.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:54.990+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.036+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-27T17:27:55.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.117+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.144+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.157+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.208 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.205+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-27T17:27:55.260 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.257+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.279 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.277+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.287+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.325 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.323+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-27T17:27:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.396+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.426+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.437+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.481+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-27T17:27:55.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.520+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.536 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.534+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.551 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.549+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.580 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.578+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-27T17:27:55.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.612+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.627+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.635+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.668 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.666+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-27T17:27:55.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.791+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.824+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.840+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.894+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-27T17:27:55.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.950+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:55.970 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.968+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:55.980 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:55.978+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.018 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.015+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-27T17:27:56.074 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.072+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.089+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.098+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.148 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.146+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-27T17:27:56.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.250+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.292 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.290+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.311 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.309+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.407+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-27T17:27:56.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.453+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.475 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.472+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.483+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.520 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.518+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-27T17:27:56.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.568+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.585 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.583+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.590+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.641+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-27T17:27:56.717 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.714+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.747 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.745+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.767+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.835+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-27T17:27:56.899 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.897+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.919+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:56.930 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.928+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:56.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:56.976+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-27T17:27:57.059 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.056+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.094+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.113 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.111+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.168 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.166+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-27T17:27:57.227 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.222+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.241+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.251+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.293 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.290+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-27T17:27:57.379 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.377+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.413+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.433 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.431+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.490+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-27T17:27:57.570 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.568+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.594+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.606+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.660 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.658+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-27T17:27:57.740 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.737+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.762+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.776 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.774+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.824 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.822+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-27T17:27:57.872 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.869+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.887 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.885+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:57.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.893+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:57.930 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.928+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-27T17:27:57.975 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:57.973+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.041+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-27T17:27:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.054+0000 7ffa7a76eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-27T17:27:58.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.159+0000 7ffa7a76eec0 20 remove_watcher() i=0 2019-11-27T17:27:58.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.159+0000 7ffa7a76eec0 2 removed watcher, disabling cache 2019-11-27T17:27:58.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.202+0000 7ffa7a76eec0 20 remove_watcher() i=1 2019-11-27T17:27:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.237+0000 7ffa7a76eec0 20 remove_watcher() i=2 2019-11-27T17:27:58.313 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.310+0000 7ffa7a76eec0 20 remove_watcher() i=3 2019-11-27T17:27:58.374 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.371+0000 7ffa7a76eec0 20 remove_watcher() i=4 2019-11-27T17:27:58.414 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.412+0000 7ffa7a76eec0 20 remove_watcher() i=5 2019-11-27T17:27:58.461 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.459+0000 7ffa7a76eec0 20 remove_watcher() i=6 2019-11-27T17:27:58.505 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:58.502+0000 7ffa7a76eec0 20 remove_watcher() i=7 2019-11-27T17:27:58.514 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-27T17:27:58.541 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}} 2019-11-27T17:27:58.542 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-27T17:27:58.542 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-27T17:27:58.542 INFO:teuthology.orchestra.run.smithi156:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-27T17:27:58.619 INFO:teuthology.orchestra.run.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-27T17:27:59.096 INFO:tasks.s3tests:Creating rgw users... 2019-11-27T17:27:59.097 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-27T17:27:59.097 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key KKUKPNJXKHZNYJRCTKQO --secret hxB/tBkZ5U6qHpHPenHv7Qc9JiPQxw1fhVcYP//cWwjk3GCWHMjDvw== --email bar.client.0+test@test.test --cluster ceph 2019-11-27T17:27:59.219 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.217+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.240 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.238+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.241 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.238+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.250 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.248+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.248+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.254+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.254+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.262+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.522+0000 7efc50e41ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:27:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.522+0000 7efc50e41ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:27:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.522+0000 7efc50e41ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:27:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.522+0000 7efc50e41ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:27:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.522+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.534+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:59.537 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.534+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.555+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.555+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.565+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:59.568 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.565+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.587+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.587+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.594+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.594+0000 7efc50e41ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:27:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.594+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.612+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.615 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.612+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.626+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.626+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.643+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:27:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.644+0000 7efc50e41ec0 20 zonegroup default 2019-11-27T17:27:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.644+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.652+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.652+0000 7efc50e41ec0 10 Cannot find current period zone using local zone 2019-11-27T17:27:59.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.652+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.661 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.658+0000 7efc50e41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:27:59.661 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.658+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.668 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.666+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:27:59.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.666+0000 7efc50e41ec0 20 rados->read ofs=0 len=0 2019-11-27T17:27:59.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.683+0000 7efc50e41ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:27:59.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.683+0000 7efc50e41ec0 20 zone default found 2019-11-27T17:27:59.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.683+0000 7efc50e41ec0 20 started sync module instance, tier type = 2019-11-27T17:27:59.686 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:27:59.683+0000 7efc50e41ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:00.111 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=0 2019-11-27T17:28:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=1 2019-11-27T17:28:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=2 2019-11-27T17:28:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=3 2019-11-27T17:28:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=4 2019-11-27T17:28:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.109+0000 7efc50e41ec0 20 add_watcher() i=5 2019-11-27T17:28:00.121 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.118+0000 7efc50e41ec0 20 add_watcher() i=6 2019-11-27T17:28:00.152 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.150+0000 7efc50e41ec0 20 add_watcher() i=7 2019-11-27T17:28:00.153 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.150+0000 7efc50e41ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:00.153 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.150+0000 7efc0efdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:00.154 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.152+0000 7efc3d86d700 0 -- >> v2:172.21.15.156:3300/0 conn(0x55a3945dcb50 msgr2=0x55a3945df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:28:00.202 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:00.200+0000 7efc3e86f700 0 -- 172.21.15.156:0/1092435891 >> [v2:172.21.15.156:6800/9504,v1:172.21.15.156:6801/9504] conn(0x7efb80017580 msgr2=0x7efb80019a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efb7d7fa700 20 reqs_thread_entry: start 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efb76ffd700 20 reqs_thread_entry: start 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efc50e41ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efb757fa700 20 reqs_thread_entry: start 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efc50e41ec0 20 get_system_obj_state: rctx=0x7fffbef5d018 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55a39465bc40 s->prefetch_data=0 2019-11-27T17:28:02.058 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.055+0000 7efc50e41ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T17:28:02.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.065+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-27T17:28:02.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.066+0000 7efc50e41ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:02.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.066+0000 7efc50e41ec0 20 get_system_obj_state: rctx=0x7fffbef5d028 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55a39465d9d0 s->prefetch_data=0 2019-11-27T17:28:02.068 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.066+0000 7efc50e41ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-27T17:28:02.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.074+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-27T17:28:02.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.074+0000 7efc50e41ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:28:02.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.074+0000 7efc50e41ec0 20 get_system_obj_state: rctx=0x7fffbef5d028 obj=default.rgw.meta:users.keys:KKUKPNJXKHZNYJRCTKQO state=0x55a39465d9d0 s->prefetch_data=0 2019-11-27T17:28:02.077 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.074+0000 7efc50e41ec0 10 cache get: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO : miss 2019-11-27T17:28:02.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.086+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO info.flags=0x0 2019-11-27T17:28:02.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.086+0000 7efc50e41ec0 10 adding default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO to cache LRU end 2019-11-27T17:28:02.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.086+0000 7efc50e41ec0 20 get_system_obj_state: rctx=0x7fffbef5cc38 obj=default.rgw.meta:users.keys:KKUKPNJXKHZNYJRCTKQO state=0x55a39465d9d0 s->prefetch_data=0 2019-11-27T17:28:02.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.086+0000 7efc50e41ec0 10 cache get: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:02.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.098+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO info.flags=0x0 2019-11-27T17:28:02.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.098+0000 7efc50e41ec0 10 moving default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO to cache LRU end 2019-11-27T17:28:02.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.098+0000 7efc50e41ec0 20 get_system_obj_state: rctx=0x7fffbef5cdb8 obj=default.rgw.meta:users.keys:KKUKPNJXKHZNYJRCTKQO state=0x55a39465d9d0 s->prefetch_data=0 2019-11-27T17:28:02.101 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.098+0000 7efc50e41ec0 10 cache get: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:02.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.109+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO info.flags=0x0 2019-11-27T17:28:02.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.109+0000 7efc50e41ec0 10 moving default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO to cache LRU end 2019-11-27T17:28:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.193+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:28:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.193+0000 7efc50e41ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.193+0000 7efc50e41ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-27T17:28:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.202+0000 7efc1f7fe700 10 RGWWatcher::handle_notify() notify_id 566935683107 cookie 94161057085664 notifier 4610 bl.length()=617 2019-11-27T17:28:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.202+0000 7efc1f7fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:28:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.202+0000 7efc1f7fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:02.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.328+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:02.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.328+0000 7efc50e41ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:28:02.330 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.328+0000 7efc50e41ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-27T17:28:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.338+0000 7efc1f7fe700 10 RGWWatcher::handle_notify() notify_id 566935683108 cookie 94161057085664 notifier 4610 bl.length()=194 2019-11-27T17:28:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.338+0000 7efc1f7fe700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.338+0000 7efc1f7fe700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T17:28:02.578 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.575+0000 7efc50e41ec0 10 cache put: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO info.flags=0x7 2019-11-27T17:28:02.579 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.575+0000 7efc50e41ec0 10 moving default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO to cache LRU end 2019-11-27T17:28:02.579 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.575+0000 7efc50e41ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=186 2019-11-27T17:28:02.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.587+0000 7efc1f7fe700 10 RGWWatcher::handle_notify() notify_id 566935683140 cookie 94161057126224 notifier 4610 bl.length()=186 2019-11-27T17:28:02.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.587+0000 7efc1f7fe700 10 cache put: name=default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO info.flags=0x7 2019-11-27T17:28:02.590 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.587+0000 7efc1f7fe700 10 moving default.rgw.meta+users.keys+KKUKPNJXKHZNYJRCTKQO to cache LRU end 2019-11-27T17:28:02.810 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T17:28:02.810 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "bar.client.0", 2019-11-27T17:28:02.810 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. bar.client.0", 2019-11-27T17:28:02.811 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "bar.client.0+test@test.test", 2019-11-27T17:28:02.811 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T17:28:02.811 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T17:28:02.811 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T17:28:02.811 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T17:28:02.812 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T17:28:02.812 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "bar.client.0", 2019-11-27T17:28:02.812 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "KKUKPNJXKHZNYJRCTKQO", 2019-11-27T17:28:02.812 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "hxB/tBkZ5U6qHpHPenHv7Qc9JiPQxw1fhVcYP//cWwjk3GCWHMjDvw==" 2019-11-27T17:28:02.813 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T17:28:02.813 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T17:28:02.813 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T17:28:02.813 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T17:28:02.814 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T17:28:02.814 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T17:28:02.814 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T17:28:02.814 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T17:28:02.814 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T17:28:02.815 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:02.815 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:02.815 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:02.815 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:02.816 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:02.816 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:02.816 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T17:28:02.817 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:02.817 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:02.817 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:02.818 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:02.818 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:02.818 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:02.818 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T17:28:02.818 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T17:28:02.819 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T17:28:02.819 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T17:28:02.819 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:02.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.867+0000 7efc50e41ec0 20 remove_watcher() i=0 2019-11-27T17:28:02.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.867+0000 7efc50e41ec0 2 removed watcher, disabling cache 2019-11-27T17:28:02.915 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.913+0000 7efc50e41ec0 20 remove_watcher() i=1 2019-11-27T17:28:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:02.980+0000 7efc50e41ec0 20 remove_watcher() i=2 2019-11-27T17:28:03.046 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.044+0000 7efc50e41ec0 20 remove_watcher() i=3 2019-11-27T17:28:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.084+0000 7efc50e41ec0 20 remove_watcher() i=4 2019-11-27T17:28:03.135 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.132+0000 7efc50e41ec0 20 remove_watcher() i=5 2019-11-27T17:28:03.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.198+0000 7efc50e41ec0 20 remove_watcher() i=6 2019-11-27T17:28:03.250 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.248+0000 7efc50e41ec0 20 remove_watcher() i=7 2019-11-27T17:28:03.258 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 5630888782 --totp-seed 22WD366ZGE3JF5T4TL2RXJUIFXHWSLJUTP76ZFXGDXAJYQDEM7XZAKCSSTUAAQ7I --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T17:28:03.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.425+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.460 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.458+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.460 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.458+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.470 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.468+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.471 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.468+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.477 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.474+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.477 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.474+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.482+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:03.768 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.766+0000 7fe8af33fec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:28:03.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.766+0000 7fe8af33fec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:28:03.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.766+0000 7fe8af33fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:28:03.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.766+0000 7fe8af33fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:28:03.769 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.766+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.781 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.779+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:03.782 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.779+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.789+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.789+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.800+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.800+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.809+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.809+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.820+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.820+0000 7fe8af33fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:28:03.822 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.820+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.830 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.827+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.830 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.828+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.838+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.838+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.853+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.853+0000 7fe8af33fec0 20 zonegroup default 2019-11-27T17:28:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.853+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.860+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.860+0000 7fe8af33fec0 10 Cannot find current period zone using local zone 2019-11-27T17:28:03.863 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.860+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.868 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.866+0000 7fe8af33fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:03.869 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.866+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.879+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.879+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.897+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.897+0000 7fe8af33fec0 20 zone default found 2019-11-27T17:28:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.897+0000 7fe8af33fec0 20 started sync module instance, tier type = 2019-11-27T17:28:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:03.897+0000 7fe8af33fec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:04.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=0 2019-11-27T17:28:07.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=1 2019-11-27T17:28:07.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=2 2019-11-27T17:28:07.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=3 2019-11-27T17:28:07.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=4 2019-11-27T17:28:07.424 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.240+0000 7fe8af33fec0 20 add_watcher() i=5 2019-11-27T17:28:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.261+0000 7fe8af33fec0 20 add_watcher() i=6 2019-11-27T17:28:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.285+0000 7fe8af33fec0 20 add_watcher() i=7 2019-11-27T17:28:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.285+0000 7fe8af33fec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.285+0000 7fe86cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.293+0000 7fe89bd6b700 0 -- 172.21.15.156:0/2241277690 >> v1:172.21.15.156:6789/0 conn(0x55645c30d210 legacy=0x55645c30f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:04.348+0000 7fe89c56c700 0 -- 172.21.15.156:0/3895908646 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x55645c320860 msgr2=0x55645c322c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.037+0000 7fe7deffd700 20 reqs_thread_entry: start 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.037+0000 7fe7dcff9700 20 reqs_thread_entry: start 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.037+0000 7fe8af33fec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.038+0000 7fe7d2ffd700 20 reqs_thread_entry: start 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.038+0000 7fe8af33fec0 20 get_system_obj_state: rctx=0x7fff748a4418 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55645c38d320 s->prefetch_data=0 2019-11-27T17:28:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.038+0000 7fe8af33fec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.058+0000 7fe8af33fec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:07.428 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.081+0000 7fe8af33fec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-27T17:28:07.429 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.081+0000 7fe8af33fec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-27T17:28:07.429 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:06.081+0000 7fe8af33fec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:08.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.964+0000 7fe8af33fec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:28:08.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.964+0000 7fe8af33fec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:08.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.964+0000 7fe8af33fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-27T17:28:08.974 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.972+0000 7fe881ffb700 10 RGWWatcher::handle_notify() notify_id 575525617701 cookie 93889531679232 notifier 4619 bl.length()=631 2019-11-27T17:28:08.974 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.972+0000 7fe881ffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T17:28:08.974 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:08.972+0000 7fe881ffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T17:28:09.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:09.703+0000 7fe8af33fec0 20 remove_watcher() i=0 2019-11-27T17:28:09.706 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:09.703+0000 7fe8af33fec0 2 removed watcher, disabling cache 2019-11-27T17:28:09.957 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:09.955+0000 7fe8af33fec0 20 remove_watcher() i=1 2019-11-27T17:28:09.994 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:09.992+0000 7fe8af33fec0 20 remove_watcher() i=2 2019-11-27T17:28:10.053 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.051+0000 7fe8af33fec0 20 remove_watcher() i=3 2019-11-27T17:28:10.093 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.091+0000 7fe8af33fec0 20 remove_watcher() i=4 2019-11-27T17:28:10.257 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.255+0000 7fe8af33fec0 20 remove_watcher() i=5 2019-11-27T17:28:10.312 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.309+0000 7fe8af33fec0 20 remove_watcher() i=6 2019-11-27T17:28:10.363 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.361+0000 7fe8af33fec0 20 remove_watcher() i=7 2019-11-27T17:28:10.371 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-27T17:28:10.371 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key YGYPQRNQWBDVWXOJILAH --secret u06F7UyBPLZrd35G7T3Aq0clMlPugWJM60wkjfX70ciUkV+P6mfnMQ== --email foo.client.0+test@test.test --cluster ceph 2019-11-27T17:28:10.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.538+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.563 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.561+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.564 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.561+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.571+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.571+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.580 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.578+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.580 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.578+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.586+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.772+0000 7f867b57cec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:28:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.772+0000 7f867b57cec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:28:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.772+0000 7f867b57cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:28:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.772+0000 7f867b57cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:28:10.775 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.772+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.782+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:10.785 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.782+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.801+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:10.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.801+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.816+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:10.818 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.816+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.831+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:10.834 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.831+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.843+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.843+0000 7f867b57cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:28:10.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.843+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.849+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.849+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.862+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.862+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.881 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.879+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:10.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.879+0000 7f867b57cec0 20 zonegroup default 2019-11-27T17:28:10.882 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.879+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.891+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.891+0000 7f867b57cec0 10 Cannot find current period zone using local zone 2019-11-27T17:28:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.891+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.900 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.898+0000 7f867b57cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:10.900 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.898+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.909 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.907+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:10.909 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.907+0000 7f867b57cec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:10.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.928+0000 7f867b57cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:10.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.928+0000 7f867b57cec0 20 zone default found 2019-11-27T17:28:10.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.928+0000 7f867b57cec0 20 started sync module instance, tier type = 2019-11-27T17:28:10.931 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:10.928+0000 7f867b57cec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:11.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=0 2019-11-27T17:28:11.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=1 2019-11-27T17:28:11.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=2 2019-11-27T17:28:11.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=3 2019-11-27T17:28:11.377 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=4 2019-11-27T17:28:11.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=5 2019-11-27T17:28:11.378 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.374+0000 7f867b57cec0 20 add_watcher() i=6 2019-11-27T17:28:11.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.409+0000 7f867b57cec0 20 add_watcher() i=7 2019-11-27T17:28:11.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.409+0000 7f867b57cec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:11.412 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.410+0000 7f8638fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:11.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.425+0000 7f865ffa8700 0 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56050f70a230 msgr2=0x56050f70c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:11.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:11.543+0000 7f86687a9700 0 -- 172.21.15.156:0/244989230 >> [v2:172.21.15.156:6823/10489,v1:172.21.15.156:6825/10489] conn(0x56050f71b230 msgr2=0x56050f71d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:13.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f85aaffd700 20 reqs_thread_entry: start 2019-11-27T17:28:13.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f85a8ff9700 20 reqs_thread_entry: start 2019-11-27T17:28:13.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f867b57cec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:13.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f859effd700 20 reqs_thread_entry: start 2019-11-27T17:28:13.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f867b57cec0 20 get_system_obj_state: rctx=0x7ffdbdd66a68 obj=default.rgw.meta:users.uid:foo.client.0 state=0x56050f781d00 s->prefetch_data=0 2019-11-27T17:28:13.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.161+0000 7f867b57cec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T17:28:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.175+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-27T17:28:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.175+0000 7f867b57cec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.175+0000 7f867b57cec0 20 get_system_obj_state: rctx=0x7ffdbdd66a78 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x56050f783a90 s->prefetch_data=0 2019-11-27T17:28:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.175+0000 7f867b57cec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-27T17:28:13.184 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.182+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-27T17:28:13.185 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.182+0000 7f867b57cec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:28:13.185 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.182+0000 7f867b57cec0 20 get_system_obj_state: rctx=0x7ffdbdd66a78 obj=default.rgw.meta:users.keys:YGYPQRNQWBDVWXOJILAH state=0x56050f783a90 s->prefetch_data=0 2019-11-27T17:28:13.185 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.182+0000 7f867b57cec0 10 cache get: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH : miss 2019-11-27T17:28:13.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.195+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH info.flags=0x0 2019-11-27T17:28:13.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.195+0000 7f867b57cec0 10 adding default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH to cache LRU end 2019-11-27T17:28:13.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.196+0000 7f867b57cec0 20 get_system_obj_state: rctx=0x7ffdbdd66688 obj=default.rgw.meta:users.keys:YGYPQRNQWBDVWXOJILAH state=0x56050f783a90 s->prefetch_data=0 2019-11-27T17:28:13.198 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.196+0000 7f867b57cec0 10 cache get: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:13.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.209+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH info.flags=0x0 2019-11-27T17:28:13.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.209+0000 7f867b57cec0 10 moving default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH to cache LRU end 2019-11-27T17:28:13.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.209+0000 7f867b57cec0 20 get_system_obj_state: rctx=0x7ffdbdd66808 obj=default.rgw.meta:users.keys:YGYPQRNQWBDVWXOJILAH state=0x56050f783a90 s->prefetch_data=0 2019-11-27T17:28:13.212 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.209+0000 7f867b57cec0 10 cache get: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.224+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH info.flags=0x0 2019-11-27T17:28:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.224+0000 7f867b57cec0 10 moving default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH to cache LRU end 2019-11-27T17:28:13.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.318+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:28:13.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.318+0000 7f867b57cec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:13.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.318+0000 7f867b57cec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-27T17:28:13.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.333+0000 7f865dfa4700 10 RGWWatcher::handle_notify() notify_id 579820584983 cookie 94579733717120 notifier 4929 bl.length()=617 2019-11-27T17:28:13.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.333+0000 7f865dfa4700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:28:13.336 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.333+0000 7f865dfa4700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:13.572 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.570+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:13.573 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.570+0000 7f867b57cec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:28:13.573 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.570+0000 7f867b57cec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-27T17:28:13.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.589+0000 7f865dfa4700 10 RGWWatcher::handle_notify() notify_id 579820585029 cookie 94579733758544 notifier 4929 bl.length()=194 2019-11-27T17:28:13.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.589+0000 7f865dfa4700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:13.592 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.589+0000 7f865dfa4700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T17:28:13.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.945+0000 7f867b57cec0 10 cache put: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH info.flags=0x7 2019-11-27T17:28:13.947 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.945+0000 7f867b57cec0 10 moving default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH to cache LRU end 2019-11-27T17:28:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.945+0000 7f867b57cec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=186 2019-11-27T17:28:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.962+0000 7f865dfa4700 10 RGWWatcher::handle_notify() notify_id 579820584998 cookie 94579733719232 notifier 4929 bl.length()=186 2019-11-27T17:28:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.962+0000 7f865dfa4700 10 cache put: name=default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH info.flags=0x7 2019-11-27T17:28:13.965 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:13.962+0000 7f865dfa4700 10 moving default.rgw.meta+users.keys+YGYPQRNQWBDVWXOJILAH to cache LRU end 2019-11-27T17:28:14.182 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "foo.client.0", 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. foo.client.0", 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "foo.client.0+test@test.test", 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T17:28:14.183 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "foo.client.0", 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "YGYPQRNQWBDVWXOJILAH", 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "u06F7UyBPLZrd35G7T3Aq0clMlPugWJM60wkjfX70ciUkV+P6mfnMQ==" 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T17:28:14.184 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T17:28:14.185 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T17:28:14.186 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:14.187 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T17:28:14.188 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T17:28:14.188 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T17:28:14.188 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T17:28:14.188 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:14.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.264+0000 7f867b57cec0 20 remove_watcher() i=0 2019-11-27T17:28:14.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.264+0000 7f867b57cec0 2 removed watcher, disabling cache 2019-11-27T17:28:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.317+0000 7f867b57cec0 20 remove_watcher() i=1 2019-11-27T17:28:14.356 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.354+0000 7f867b57cec0 20 remove_watcher() i=2 2019-11-27T17:28:14.470 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.467+0000 7f867b57cec0 20 remove_watcher() i=3 2019-11-27T17:28:14.522 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.519+0000 7f867b57cec0 20 remove_watcher() i=4 2019-11-27T17:28:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.573+0000 7f867b57cec0 20 remove_watcher() i=5 2019-11-27T17:28:14.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.616+0000 7f867b57cec0 20 remove_watcher() i=6 2019-11-27T17:28:14.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.659+0000 7f867b57cec0 20 remove_watcher() i=7 2019-11-27T17:28:14.668 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6949022969 --totp-seed PCVDVNWG2UXETMPK2CFENL4RXDYNYD42HRZ3YEFUYSI2SVSDENAJ6YZRK2EJWMSE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T17:28:14.806 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.803+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:14.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.824+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:14.827 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.824+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:14.838 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.836+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.836+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:14.845 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.843+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:14.846 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.843+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:14.857 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:14.855+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:15.065 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.062+0000 7f670db07ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:28:15.065 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.063+0000 7f670db07ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:28:15.065 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.063+0000 7f670db07ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:28:15.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.063+0000 7f670db07ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:28:15.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.063+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.070+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:15.073 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.070+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.090+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:15.092 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.090+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.101+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:15.104 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.101+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.110+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:15.113 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.110+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.120+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.120+0000 7f670db07ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:28:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.120+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.129+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:15.132 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.129+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.138+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.138+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.157+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:15.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.158+0000 7f670db07ec0 20 zonegroup default 2019-11-27T17:28:15.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.158+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.174 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.172+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:15.174 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.172+0000 7f670db07ec0 10 Cannot find current period zone using local zone 2019-11-27T17:28:15.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.172+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.183 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.180+0000 7f670db07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:15.183 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.180+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.197 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.194+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:15.197 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.194+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.214+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.214+0000 7f670db07ec0 20 zone default found 2019-11-27T17:28:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.214+0000 7f670db07ec0 20 started sync module instance, tier type = 2019-11-27T17:28:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.214+0000 7f670db07ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=0 2019-11-27T17:28:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=1 2019-11-27T17:28:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=2 2019-11-27T17:28:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=3 2019-11-27T17:28:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=4 2019-11-27T17:28:15.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=5 2019-11-27T17:28:15.897 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.893+0000 7f670db07ec0 20 add_watcher() i=6 2019-11-27T17:28:15.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.938+0000 7f670db07ec0 20 add_watcher() i=7 2019-11-27T17:28:15.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.938+0000 7f670db07ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:15.944 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.938+0000 7f66cb7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:15.945 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:15.939+0000 7f66fa533700 0 -- >> v1:172.21.15.3:6789/0 conn(0x55a592e07ec0 legacy=0x55a592e0a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T17:28:16.056 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:16.054+0000 7f66fb535700 0 -- 172.21.15.156:0/1502122456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c003960 msgr2=0x7f663c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:17.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.508+0000 7f6639ffb700 20 reqs_thread_entry: start 2019-11-27T17:28:17.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.508+0000 7f66337fe700 20 reqs_thread_entry: start 2019-11-27T17:28:17.511 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.508+0000 7f670db07ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:17.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.509+0000 7f6631ffb700 20 reqs_thread_entry: start 2019-11-27T17:28:17.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.509+0000 7f670db07ec0 20 get_system_obj_state: rctx=0x7ffd15ecb9a8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55a592e7c6e0 s->prefetch_data=0 2019-11-27T17:28:17.512 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.509+0000 7f670db07ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T17:28:17.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-27T17:28:17.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:17.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:28:17.532 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:28:17.533 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:28:17.533 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.529+0000 7f670db07ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:17.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.553+0000 7f670db07ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-27T17:28:17.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.553+0000 7f670db07ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-27T17:28:17.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.553+0000 7f670db07ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:17.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.715+0000 7f670db07ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:28:17.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.715+0000 7f670db07ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:17.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.716+0000 7f670db07ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-27T17:28:17.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.730+0000 7f66dbfff700 10 RGWWatcher::handle_notify() notify_id 579820584984 cookie 94169622028240 notifier 4954 bl.length()=631 2019-11-27T17:28:17.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.730+0000 7f66dbfff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T17:28:17.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:17.730+0000 7f66dbfff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T17:28:18.107 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.105+0000 7f670db07ec0 20 remove_watcher() i=0 2019-11-27T17:28:18.108 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.105+0000 7f670db07ec0 2 removed watcher, disabling cache 2019-11-27T17:28:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.143+0000 7f670db07ec0 20 remove_watcher() i=1 2019-11-27T17:28:18.179 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.177+0000 7f670db07ec0 20 remove_watcher() i=2 2019-11-27T17:28:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.220+0000 7f670db07ec0 20 remove_watcher() i=3 2019-11-27T17:28:18.268 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.266+0000 7f670db07ec0 20 remove_watcher() i=4 2019-11-27T17:28:18.313 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.310+0000 7f670db07ec0 20 remove_watcher() i=5 2019-11-27T17:28:18.347 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.345+0000 7f670db07ec0 20 remove_watcher() i=6 2019-11-27T17:28:18.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.385+0000 7f670db07ec0 20 remove_watcher() i=7 2019-11-27T17:28:18.399 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-27T17:28:18.400 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key VJLTUPCYUONTGFESFQEH --secret M+QztnhgZ0pL8IF96KFZS2b2G4LMgBzLDjIVU4EADb5KKifw0ljMyQ== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-27T17:28:18.560 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.558+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.582+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:18.584 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.582+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.594+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:18.597 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.594+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.603 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.601+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:18.603 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.601+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.614 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.612+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:18.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.900+0000 7fe39b541ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:28:18.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.900+0000 7fe39b541ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:28:18.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.900+0000 7fe39b541ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:28:18.913 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.900+0000 7fe39b541ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:28:18.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.900+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.909+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:18.914 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.909+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.925+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:18.927 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.925+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.937+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:18.939 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.937+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.957+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:18.960 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.957+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.968+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:18.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.968+0000 7fe39b541ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:28:18.971 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.968+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.978 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.976+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:18.979 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.976+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:18.992 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.990+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:18.993 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:18.990+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.006+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.006+0000 7fe39b541ec0 20 zonegroup default 2019-11-27T17:28:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.006+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:19.015 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.012+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:19.015 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.012+0000 7fe39b541ec0 10 Cannot find current period zone using local zone 2019-11-27T17:28:19.015 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.012+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:19.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.023+0000 7fe39b541ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:19.025 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.023+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:19.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.035+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:19.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.035+0000 7fe39b541ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:19.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.051+0000 7fe39b541ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:19.054 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.051+0000 7fe39b541ec0 20 zone default found 2019-11-27T17:28:19.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.051+0000 7fe39b541ec0 20 started sync module instance, tier type = 2019-11-27T17:28:19.055 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.051+0000 7fe39b541ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.437+0000 7fe39b541ec0 20 add_watcher() i=0 2019-11-27T17:28:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.438+0000 7fe39b541ec0 20 add_watcher() i=1 2019-11-27T17:28:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.438+0000 7fe39b541ec0 20 add_watcher() i=2 2019-11-27T17:28:19.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.438+0000 7fe39b541ec0 20 add_watcher() i=3 2019-11-27T17:28:19.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.438+0000 7fe39b541ec0 20 add_watcher() i=4 2019-11-27T17:28:19.441 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.438+0000 7fe39b541ec0 20 add_watcher() i=5 2019-11-27T17:28:19.471 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.468+0000 7fe39b541ec0 20 add_watcher() i=6 2019-11-27T17:28:19.481 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.479+0000 7fe39b541ec0 20 add_watcher() i=7 2019-11-27T17:28:19.481 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.479+0000 7fe39b541ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:19.481 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.479+0000 7fe358fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:19.484 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.482+0000 7fe388f6f700 0 -- 172.21.15.156:0/182186056 >> v1:172.21.15.3:6789/0 conn(0x55b833194c80 legacy=0x55b833198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:28:19.527 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:19.525+0000 7fe38876e700 0 -- 172.21.15.156:0/4267628002 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x55b8331ae520 msgr2=0x55b8331b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:21.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.263+0000 7fe2caffd700 20 reqs_thread_entry: start 2019-11-27T17:28:21.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.264+0000 7fe2c8ff9700 20 reqs_thread_entry: start 2019-11-27T17:28:21.266 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.264+0000 7fe39b541ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:21.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.265+0000 7fe2beffd700 20 reqs_thread_entry: start 2019-11-27T17:28:21.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.265+0000 7fe39b541ec0 20 get_system_obj_state: rctx=0x7ffc4df83db8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55b83321b110 s->prefetch_data=0 2019-11-27T17:28:21.267 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.265+0000 7fe39b541ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T17:28:21.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.275+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-27T17:28:21.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.275+0000 7fe39b541ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:21.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.275+0000 7fe39b541ec0 20 get_system_obj_state: rctx=0x7ffc4df83dc8 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55b83321cec0 s->prefetch_data=0 2019-11-27T17:28:21.278 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.275+0000 7fe39b541ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-27T17:28:21.287 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.284+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-27T17:28:21.287 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.284+0000 7fe39b541ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T17:28:21.287 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.284+0000 7fe39b541ec0 20 get_system_obj_state: rctx=0x7ffc4df83dc8 obj=default.rgw.meta:users.keys:VJLTUPCYUONTGFESFQEH state=0x55b83321cec0 s->prefetch_data=0 2019-11-27T17:28:21.287 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.284+0000 7fe39b541ec0 10 cache get: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH : miss 2019-11-27T17:28:21.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.302+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH info.flags=0x0 2019-11-27T17:28:21.304 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.302+0000 7fe39b541ec0 10 adding default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH to cache LRU end 2019-11-27T17:28:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.302+0000 7fe39b541ec0 20 get_system_obj_state: rctx=0x7ffc4df839d8 obj=default.rgw.meta:users.keys:VJLTUPCYUONTGFESFQEH state=0x55b83321cec0 s->prefetch_data=0 2019-11-27T17:28:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.302+0000 7fe39b541ec0 10 cache get: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:21.320 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.318+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH info.flags=0x0 2019-11-27T17:28:21.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.318+0000 7fe39b541ec0 10 moving default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH to cache LRU end 2019-11-27T17:28:21.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.318+0000 7fe39b541ec0 20 get_system_obj_state: rctx=0x7ffc4df83b58 obj=default.rgw.meta:users.keys:VJLTUPCYUONTGFESFQEH state=0x55b83321cec0 s->prefetch_data=0 2019-11-27T17:28:21.321 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.318+0000 7fe39b541ec0 10 cache get: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH : type miss (requested=0x6, cached=0x0) 2019-11-27T17:28:21.334 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.332+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH info.flags=0x0 2019-11-27T17:28:21.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.332+0000 7fe39b541ec0 10 moving default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH to cache LRU end 2019-11-27T17:28:21.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.424+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T17:28:21.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.424+0000 7fe39b541ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:21.427 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.424+0000 7fe39b541ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-27T17:28:21.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.441+0000 7fe36dffb700 10 RGWWatcher::handle_notify() notify_id 579820585035 cookie 94249619573520 notifier 4637 bl.length()=691 2019-11-27T17:28:21.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.441+0000 7fe36dffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T17:28:21.444 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.441+0000 7fe36dffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:21.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.711+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:21.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.711+0000 7fe39b541ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T17:28:21.714 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.711+0000 7fe39b541ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-27T17:28:21.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.729+0000 7fe36dffb700 10 RGWWatcher::handle_notify() notify_id 579820585030 cookie 94249619590128 notifier 4637 bl.length()=224 2019-11-27T17:28:21.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.729+0000 7fe36dffb700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-27T17:28:21.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:21.729+0000 7fe36dffb700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-27T17:28:22.114 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.111+0000 7fe39b541ec0 10 cache put: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH info.flags=0x7 2019-11-27T17:28:22.114 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.111+0000 7fe39b541ec0 10 moving default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH to cache LRU end 2019-11-27T17:28:22.114 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.111+0000 7fe39b541ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=201 2019-11-27T17:28:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.157+0000 7fe36dffb700 10 RGWWatcher::handle_notify() notify_id 579820585036 cookie 94249619551632 notifier 4637 bl.length()=201 2019-11-27T17:28:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.157+0000 7fe36dffb700 10 cache put: name=default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH info.flags=0x7 2019-11-27T17:28:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.157+0000 7fe36dffb700 10 moving default.rgw.meta+users.keys+VJLTUPCYUONTGFESFQEH to cache LRU end 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T17:28:22.762 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "testx$tenanteduser.client.0", 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "VJLTUPCYUONTGFESFQEH", 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "M+QztnhgZ0pL8IF96KFZS2b2G4LMgBzLDjIVU4EADb5KKifw0ljMyQ==" 2019-11-27T17:28:22.763 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T17:28:22.764 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:22.765 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T17:28:22.766 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T17:28:22.767 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T17:28:22.767 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T17:28:22.767 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T17:28:22.767 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T17:28:22.767 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:22.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.826+0000 7fe39b541ec0 20 remove_watcher() i=0 2019-11-27T17:28:22.828 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.826+0000 7fe39b541ec0 2 removed watcher, disabling cache 2019-11-27T17:28:22.867 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.864+0000 7fe39b541ec0 20 remove_watcher() i=1 2019-11-27T17:28:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.906+0000 7fe39b541ec0 20 remove_watcher() i=2 2019-11-27T17:28:22.986 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:22.983+0000 7fe39b541ec0 20 remove_watcher() i=3 2019-11-27T17:28:23.037 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.035+0000 7fe39b541ec0 20 remove_watcher() i=4 2019-11-27T17:28:23.080 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.077+0000 7fe39b541ec0 20 remove_watcher() i=5 2019-11-27T17:28:23.145 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.142+0000 7fe39b541ec0 20 remove_watcher() i=6 2019-11-27T17:28:23.193 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.191+0000 7fe39b541ec0 20 remove_watcher() i=7 2019-11-27T17:28:23.201 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2578766989 --totp-seed 7TFGG6QOCAAYREA7UIRKEX5Q44SBILRYASX7FERFBQWL5KDSXR23C5OWLPNQ4OTC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-27T17:28:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.321+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.342+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.342+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.353+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.356 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.353+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.359+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.362 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.359+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.369 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.367+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:23.653 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.651+0000 7f16bf718ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T17:28:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.651+0000 7f16bf718ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T17:28:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.651+0000 7f16bf718ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T17:28:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.651+0000 7f16bf718ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T17:28:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.651+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.662+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.662+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.680+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:23.682 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.680+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.690+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.690+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.707 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.705+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:23.707 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.705+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.715 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.712+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.715 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.712+0000 7f16bf718ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T17:28:23.715 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.712+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.719+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.722 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.719+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.728+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:23.731 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.728+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.748+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T17:28:23.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.748+0000 7f16bf718ec0 20 zonegroup default 2019-11-27T17:28:23.751 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.748+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.757+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.757+0000 7f16bf718ec0 10 Cannot find current period zone using local zone 2019-11-27T17:28:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.757+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.763+0000 7f16bf718ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T17:28:23.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.763+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.774 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.771+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T17:28:23.774 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.772+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:23.792 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.790+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T17:28:23.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.790+0000 7f16bf718ec0 20 zone default found 2019-11-27T17:28:23.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.790+0000 7f16bf718ec0 20 started sync module instance, tier type = 2019-11-27T17:28:23.793 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:23.790+0000 7f16bf718ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=0 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=1 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=2 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=3 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=4 2019-11-27T17:28:24.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.207+0000 7f16bf718ec0 20 add_watcher() i=5 2019-11-27T17:28:24.242 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.240+0000 7f16bf718ec0 20 add_watcher() i=6 2019-11-27T17:28:24.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.250+0000 7f16bf718ec0 20 add_watcher() i=7 2019-11-27T17:28:24.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.250+0000 7f16bf718ec0 2 all 8 watchers are set, enabling cache 2019-11-27T17:28:24.253 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.250+0000 7f167cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T17:28:24.258 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.256+0000 7f16a7fff700 0 -- 172.21.15.156:0/4059351417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5568274880b0 msgr2=0x55682748a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T17:28:24.460 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.458+0000 7f16a7fff700 0 --2- 172.21.15.156:0/4059351417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5568274880b0 0x55682748a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T17:28:24.502 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:24.500+0000 7f16ac945700 0 -- 172.21.15.156:0/2744238905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556827487c60 msgr2=0x55682748c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T17:28:25.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.904+0000 7f15eeffd700 20 reqs_thread_entry: start 2019-11-27T17:28:25.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.904+0000 7f15ecff9700 20 reqs_thread_entry: start 2019-11-27T17:28:25.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.904+0000 7f16bf718ec0 20 init_complete bucket index max shards: 0 2019-11-27T17:28:25.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.905+0000 7f15e2ffd700 20 reqs_thread_entry: start 2019-11-27T17:28:25.907 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.905+0000 7f16bf718ec0 20 get_system_obj_state: rctx=0x7fff4911bbd8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5568274ff340 s->prefetch_data=0 2019-11-27T17:28:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.905+0000 7f16bf718ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T17:28:25.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-27T17:28:25.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:25.920 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T17:28:25.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T17:28:25.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T17:28:25.921 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.917+0000 7f16bf718ec0 20 rados->read ofs=0 len=0 2019-11-27T17:28:25.936 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.934+0000 7f16bf718ec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-27T17:28:25.936 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.934+0000 7f16bf718ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-27T17:28:25.937 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:25.934+0000 7f16bf718ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:26.085 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.082+0000 7f16bf718ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T17:28:26.085 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.082+0000 7f16bf718ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:26.085 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.082+0000 7f16bf718ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-27T17:28:26.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.091+0000 7f1695ffb700 10 RGWWatcher::handle_notify() notify_id 579820585037 cookie 93905823925552 notifier 4643 bl.length()=705 2019-11-27T17:28:26.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.091+0000 7f1695ffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-27T17:28:26.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.091+0000 7f1695ffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T17:28:26.386 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.384+0000 7f16bf718ec0 20 remove_watcher() i=0 2019-11-27T17:28:26.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.384+0000 7f16bf718ec0 2 removed watcher, disabling cache 2019-11-27T17:28:26.454 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.451+0000 7f16bf718ec0 20 remove_watcher() i=1 2019-11-27T17:28:26.497 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.495+0000 7f16bf718ec0 20 remove_watcher() i=2 2019-11-27T17:28:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.554+0000 7f16bf718ec0 20 remove_watcher() i=3 2019-11-27T17:28:26.616 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.613+0000 7f16bf718ec0 20 remove_watcher() i=4 2019-11-27T17:28:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.678+0000 7f16bf718ec0 20 remove_watcher() i=5 2019-11-27T17:28:26.727 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.724+0000 7f16bf718ec0 20 remove_watcher() i=6 2019-11-27T17:28:26.765 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T17:28:26.763+0000 7f16bf718ec0 20 remove_watcher() i=7 2019-11-27T17:28:26.773 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-27T17:28:26.773 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-27T17:28:32.345 INFO:teuthology.orchestra.run.smithi156.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-27T17:28:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-27T17:28:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:Loading mirror speeds from cached hostfile 2019-11-27T17:28:32.503 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.math.princeton.edu 2019-11-27T17:28:32.504 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-27T17:28:32.504 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2019-11-27T17:28:32.504 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.umd.edu 2019-11-27T17:28:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:7 packages excluded due to repository priority protections 2019-11-27T17:28:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2019-11-27T17:28:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2019-11-27T17:28:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-27T17:28:33.945 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2019-11-27T17:28:34.189 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:34.189 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2019-11-27T17:28:34.190 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:34.190 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2019-11-27T17:28:34.191 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2019-11-27T17:28:34.192 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2019-11-27T17:28:34.192 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:34.192 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 23 k 2019-11-27T17:28:34.192 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 27 k 2019-11-27T17:28:34.192 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2019-11-27T17:28:34.301 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2019-11-27T17:28:34.305 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2019-11-27T17:28:34.308 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2019-11-27T17:28:34.308 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2019-11-27T17:28:34.804 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-27T17:28:35.203 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-27T17:28:35.204 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:35.204 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2019-11-27T17:28:35.204 INFO:teuthology.orchestra.run.smithi156.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-27T17:28:35.204 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:35.204 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2019-11-27T17:28:35.353 INFO:teuthology.orchestra.run.smithi156.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-27T17:28:36.762 INFO:teuthology.orchestra.run.smithi156.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T17:28:37.082 INFO:teuthology.orchestra.run.smithi156.stderr:Cache entry deserialization failed, entry ignored 2019-11-27T17:28:37.211 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pip 2019-11-27T17:28:37.292 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-27T17:28:37.356 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: pip 2019-11-27T17:28:37.356 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: pip 9.0.1 2019-11-27T17:28:37.419 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling pip-9.0.1: 2019-11-27T17:28:37.462 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T17:28:38.051 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed pip-19.3.1 2019-11-27T17:28:38.318 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T17:28:38.815 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting setuptools==32.3.1 2019-11-27T17:28:38.818 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-27T17:28:38.858 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: setuptools 2019-11-27T17:28:38.859 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T17:28:38.873 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T17:28:38.883 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T17:28:39.012 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed setuptools-32.3.1 2019-11-27T17:28:39.456 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T17:28:39.669 INFO:teuthology.orchestra.run.smithi156.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-27T17:28:39.732 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting nose>=1.0.0 2019-11-27T17:28:39.734 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-27T17:28:39.862 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto>=2.6.0 2019-11-27T17:28:39.877 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-27T17:28:40.524 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto3>=1.0.0 2019-11-27T17:28:40.586 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/67/17/567f679dac6ec93611ce05637094e9736afa40e41c9ed0aaefd90de6f7e8/boto3-1.10.28-py2.py3-none-any.whl (128kB) 2019-11-27T17:28:40.813 INFO:teuthology.orchestra.run.smithi156.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-27T17:28:41.077 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting gevent>=1.0 2019-11-27T17:28:41.091 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:28:41.334 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting isodate>=0.4.4 2019-11-27T17:28:41.344 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-27T17:28:41.487 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting requests>=0.14.0 2019-11-27T17:28:41.497 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-27T17:28:41.741 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pytz>=2011k 2019-11-27T17:28:41.745 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-27T17:28:41.947 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting ordereddict 2019-11-27T17:28:41.957 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-27T17:28:42.269 INFO:teuthology.orchestra.run.smithi156.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-27T17:28:42.631 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting lxml 2019-11-27T17:28:42.646 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:28:43.326 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting botocore<1.14.0,>=1.13.28 2019-11-27T17:28:43.335 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/8e/b3/ab9044d3aa14208f5b6f69665d5f82ad9b028809666e4e70dac1ab0bfd3a/botocore-1.13.28-py2.py3-none-any.whl (5.7MB) 2019-11-27T17:28:43.870 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-27T17:28:43.880 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-27T17:28:43.975 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-27T17:28:43.984 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-27T17:28:44.203 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T17:28:44.205 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T17:28:44.267 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting six 2019-11-27T17:28:44.278 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-27T17:28:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-27T17:28:44.364 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-27T17:28:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting idna<2.9,>=2.5 2019-11-27T17:28:44.476 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-27T17:28:44.602 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-27T17:28:44.612 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-27T17:28:44.764 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting certifi>=2017.4.17 2019-11-27T17:28:44.776 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB) 2019-11-27T17:28:44.874 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting docutils<0.16,>=0.10 2019-11-27T17:28:44.885 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-27T17:28:45.096 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-27T17:28:45.108 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-27T17:28:45.228 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-27T17:28:45.241 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-27T17:28:45.275 INFO:teuthology.orchestra.run.smithi156.stdout:Building wheels for collected packages: ordereddict 2019-11-27T17:28:45.276 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for ordereddict (setup.py): started 2019-11-27T17:28:45.544 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-27T17:28:45.545 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=54e58ce80d643bcaae55d7952cecf811cdf0af47427f519c0ddc58e7233959fe 2019-11-27T17:28:45.545 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-27T17:28:45.548 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully built ordereddict 2019-11-27T17:28:45.644 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-27T17:28:47.945 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.28 botocore-1.13.28 bunch-1.0.1 certifi-2019.9.11 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-27T17:28:48.291 INFO:teuthology.orchestra.run.smithi156.stdout:running develop 2019-11-27T17:28:48.345 INFO:teuthology.orchestra.run.smithi156.stdout:running egg_info 2019-11-27T17:28:48.345 INFO:teuthology.orchestra.run.smithi156.stdout:creating s3tests.egg-info 2019-11-27T17:28:48.345 INFO:teuthology.orchestra.run.smithi156.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-27T17:28:48.346 INFO:teuthology.orchestra.run.smithi156.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-27T17:28:48.346 INFO:teuthology.orchestra.run.smithi156.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-27T17:28:48.346 INFO:teuthology.orchestra.run.smithi156.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-27T17:28:48.347 INFO:teuthology.orchestra.run.smithi156.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-27T17:28:48.347 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T17:28:48.349 INFO:teuthology.orchestra.run.smithi156.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T17:28:48.350 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-27T17:28:48.351 INFO:teuthology.orchestra.run.smithi156.stdout:running build_ext 2019-11-27T17:28:48.351 INFO:teuthology.orchestra.run.smithi156.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-27T17:28:48.351 INFO:teuthology.orchestra.run.smithi156.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-27T17:28:48.354 INFO:teuthology.orchestra.run.smithi156.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T17:28:48.354 INFO:teuthology.orchestra.run.smithi156.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T17:28:48.354 INFO:teuthology.orchestra.run.smithi156.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T17:28:48.354 INFO:teuthology.orchestra.run.smithi156.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T17:28:48.354 INFO:teuthology.orchestra.run.smithi156.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-27T17:28:48.355 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.355 INFO:teuthology.orchestra.run.smithi156.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-27T17:28:48.355 INFO:teuthology.orchestra.run.smithi156.stdout:Processing dependencies for s3tests==0.0.1 2019-11-27T17:28:48.412 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for isodate==0.6.0 2019-11-27T17:28:48.412 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: isodate 0.6.0 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for gevent==1.4.0 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: gevent 1.4.0 2019-11-27T17:28:48.413 INFO:teuthology.orchestra.run.smithi156.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-27T17:28:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for bunch==1.0.1 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: bunch 1.0.1 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.415 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.416 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for PyYAML==5.1.2 2019-11-27T17:28:48.416 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: PyYAML 5.1.2 2019-11-27T17:28:48.416 INFO:teuthology.orchestra.run.smithi156.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-27T17:28:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.416 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.417 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for boto3==1.10.28 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: boto3 1.10.28 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout:Adding boto3 1.10.28 to easy-install.pth file 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for boto==2.49.0 2019-11-27T17:28:48.418 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: boto 2.49.0 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for six==1.13.0 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: six 1.13.0 2019-11-27T17:28:48.419 INFO:teuthology.orchestra.run.smithi156.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-27T17:28:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.421 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.421 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for greenlet==0.4.15 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: greenlet 0.4.15 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for s3transfer==0.2.1 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: s3transfer 0.2.1 2019-11-27T17:28:48.422 INFO:teuthology.orchestra.run.smithi156.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for jmespath==0.9.4 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: jmespath 0.9.4 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-27T17:28:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for botocore==1.13.28 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: botocore 1.13.28 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout:Adding botocore 1.13.28 to easy-install.pth file 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.424 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for futures==3.3.0 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: futures 3.3.0 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.426 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for urllib3==1.25.7 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: urllib3 1.25.7 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for python-dateutil==2.8.0 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: python-dateutil 2.8.0 2019-11-27T17:28:48.427 INFO:teuthology.orchestra.run.smithi156.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-27T17:28:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.429 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for docutils==0.15.2 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: docutils 0.15.2 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-27T17:28:48.430 INFO:teuthology.orchestra.run.smithi156.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-27T17:28:48.436 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-27T17:28:48.482 INFO:tasks.s3tests:Configuring boto... 2019-11-27T17:28:48.483 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-27T17:28:48.593 INFO:teuthology.orchestra.run.smithi156:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-27T17:28:54.292 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-27T17:28:58.115 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-27T17:29:02.997 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-27T17:29:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-27T17:29:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-27T17:29:12.497 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-27T17:29:18.828 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-27T17:29:20.980 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-27T17:29:21.640 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-27T17:29:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-27T17:29:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-27T17:29:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-27T17:29:31.978 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-27T17:29:35.335 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-27T17:29:45.681 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-27T17:29:45.681 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-27T17:29:45.681 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-27T17:29:45.681 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-27T17:29:45.681 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-27T17:29:45.682 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-27T17:29:45.683 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-27T17:29:45.683 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-27T17:29:45.683 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-27T17:29:45.683 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-27T17:29:45.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-27T17:29:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-27T17:29:45.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-27T17:29:45.687 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-27T17:29:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-27T17:29:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-27T17:29:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-27T17:29:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-27T17:29:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-27T17:29:57.131 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-27T17:30:04.283 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-27T17:31:12.478 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:19.951 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.481 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:19.955 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.518 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:19.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.524 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:19.999 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.650 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:20.125 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.673 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:20.148 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.681 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:20.150 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.772 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:20.245 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:12.828 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:20.303 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.237 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:37.710 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.246 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:37.720 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.261 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:37.737 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.264 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:37.739 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.270 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:37.744 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.270 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:37.741 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.282 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:31:37.756 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.319 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:31:37.793 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:31:30.321 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:31:37.796 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:32:14.095 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-27T17:34:54.635 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-27T17:35:02.768 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-27T17:35:06.000 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-27T17:35:09.917 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-27T17:35:13.798 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-27T17:35:13.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-27T17:35:13.800 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-27T17:35:13.801 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-27T17:35:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-27T17:35:13.803 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-27T17:35:13.803 INFO:teuthology.orchestra.run.smithi156.stderr:SKIP 2019-11-27T17:35:13.808 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-27T17:36:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-27T17:36:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-27T17:36:21.711 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-27T17:36:21.872 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-27T17:36:22.201 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-27T17:36:22.224 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-27T17:36:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-27T17:36:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-27T17:36:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-27T17:36:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-27T17:36:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-27T17:36:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-27T17:36:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-27T17:36:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-27T17:36:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-27T17:36:22.256 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-27T17:36:22.257 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-27T17:36:22.257 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-27T17:36:22.257 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-27T17:36:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-27T17:36:22.312 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-27T17:36:22.312 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-27T17:36:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-27T17:36:23.508 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:23.508 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:24.404 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:24.404 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:25.325 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:25.325 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:26.086 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:26.086 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:28.801 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:29.415 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:36:29.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:29.684 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:31.324 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:31.324 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:42.391 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:36:49.864 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.404 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:36:49.878 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.421 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:36:49.897 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.425 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:36:49.900 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.426 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:36:49.902 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.428 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:36:49.903 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.612 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:36:50.087 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.649 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:36:50.122 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:42.696 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:36:50.171 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:36:43.171 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:36:43.479 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:43.479 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:46.079 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:46.080 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:46.221 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:36:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:46.488 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:49.680 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:50.959 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:53.699 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:36:53.969 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:53.969 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:57.334 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:57.335 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:36:58.464 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:36:58.464 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:00.912 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:00.913 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:05.112 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:05.112 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:06.428 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:08.155 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:08.408 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:08.409 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:11.486 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:13.432 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:14.983 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:15.267 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:15.267 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:18.462 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:18.462 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:18.533 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:18.774 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:18.775 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:21.153 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:21.153 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:22.187 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:22.187 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:23.601 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:23.822 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:23.822 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:26.657 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:26.658 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:28.658 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:28.924 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:28.925 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:31.729 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:31.729 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:32.251 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:32.558 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:32.558 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:35.308 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:35.308 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:35.977 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:35.978 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:38.249 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:38.492 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:38.492 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:41.004 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:41.395 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:41.395 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:42.229 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:42.229 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:44.735 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:44.735 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:44.813 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:45.267 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:45.267 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:47.428 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:47.429 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:50.415 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:50.416 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:52.650 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:52.650 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:37:56.418 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:37:56.730 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:37:56.731 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:00.922 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:00.922 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:01.942 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:01.942 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:04.973 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:04.973 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:06.179 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:06.179 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:07.570 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:07.571 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:07.680 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:08.195 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:08.195 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:10.537 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:10.537 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:10.639 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:10.867 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:10.867 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:13.938 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:14.127 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:14.520 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:14.521 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:16.641 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:16.901 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:16.902 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:20.246 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:20.556 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:20.728 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:21.120 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:21.120 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:21.273 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:21.835 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:21.836 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:21.905 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:22.228 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:22.329 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:22.906 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:22.906 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:23.050 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:23.301 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:23.302 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:26.546 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:26.546 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:28.702 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:28.703 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:33.153 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:33.447 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:33.447 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:43.198 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:43.198 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:45.133 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:45.429 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:45.429 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:52.122 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:52.122 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:38:53.396 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:38:53.680 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:38:53.681 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:04.439 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:39:04.734 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:04.734 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:11.362 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:11.363 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:11.888 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:39:12.332 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:12.332 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:22.406 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:23.685 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:39:23.970 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:23.970 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:33.889 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:34.613 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:39:42.086 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.620 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:39:42.095 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.620 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:39:42.094 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.624 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:39:42.099 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.640 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:39:42.116 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.679 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:39:42.154 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.710 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:39:42.183 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.713 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:39:42.188 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:34.781 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:39:42.256 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:39:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:35.065 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:35.617 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:35.617 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:36.659 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:36.659 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:38.092 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:38.092 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:38.910 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:39.810 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:39.810 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:40.887 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:40.887 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:41.403 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:39:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:41.763 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:50.244 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:51.895 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:51.896 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:52.604 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:52.604 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:53.664 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:53.665 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:54.896 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:54.896 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:56.059 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:56.060 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:56.706 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:56.707 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:58.129 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:58.129 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:39:58.620 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:39:59.208 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:39:59.208 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:02.779 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:02.779 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:03.514 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:40:04.072 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:04.073 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:08.167 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:08.167 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:40:08.874 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:08.875 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:17.616 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:17.616 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:40:18.348 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:18.348 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:28.164 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:28.165 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:40:29.147 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:29.147 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:39.001 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:40.062 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:40.062 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:40.863 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:40.863 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:41.976 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.068 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:49.070 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.071 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:49.071 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:40:49.071 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:49.071 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:57.847 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:58.659 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:58.659 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:40:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:40:59.631 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:00.719 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:00.720 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:01.862 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:01.862 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:02.673 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:02.673 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:03.594 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:03.594 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:04.668 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:04.668 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:05.015 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:05.218 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:12.067 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:12.766 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:13.245 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:13.245 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:20.871 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:20.871 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:21.560 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:21.844 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:30.103 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:30.103 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:30.974 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:30.975 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:36.498 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:36.498 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:36.945 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:37.353 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:45.679 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:45.680 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:46.456 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:46.723 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:46.723 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:52.421 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:41:59.894 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.428 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:41:59.901 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.435 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:41:59.910 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.437 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:41:59.912 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.439 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:41:59.914 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.443 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:41:59.918 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.541 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:42:00.016 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.548 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:42:00.023 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:52.557 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:42:00.028 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:41:53.614 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:53.614 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:41:54.099 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:41:54.357 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:41:54.357 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:02.693 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:02.693 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:03.290 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:03.748 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:10.416 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:10.417 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:11.060 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:11.451 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:11.452 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:16.973 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:16.974 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:17.462 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:17.810 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:17.810 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:23.659 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:23.659 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:24.054 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:24.298 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:24.298 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:30.693 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:30.693 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:32.396 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:39.355 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:39.356 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:40.124 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:40.124 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:45.475 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:45.475 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:46.006 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:46.302 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:46.303 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:52.859 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:52.860 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:53.522 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:42:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:53.904 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:42:59.345 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:42:59.345 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:43:00.246 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:43:00.536 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:43:00.536 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:43:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:43:07.832 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:43:08.486 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:43:08.745 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:43:08.745 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:43:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:43:15.637 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:43:16.138 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T17:43:16.615 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T17:43:16.616 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T17:47:02.667 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:47:10.139 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.682 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:47:10.156 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.693 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:47:10.168 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.696 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:47:10.170 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.698 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:47:10.173 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.700 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:47:10.176 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.883 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:47:10.358 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:02.911 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:47:10.386 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:03.017 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:47:10.491 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.554 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:48:04.027 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.566 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:48:04.039 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.600 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:48:04.075 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.621 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:48:04.093 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.634 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:48:04.106 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.636 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:48:04.111 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.650 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:48:04.123 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.666 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:48:04.142 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:47:56.689 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:48:04.164 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.733 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:52:22.206 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.749 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:52:22.223 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.753 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:52:22.228 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.756 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:52:22.231 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.761 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:52:22.236 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.763 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:52:22.236 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.931 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:52:22.402 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.936 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:52:22.409 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:52:14.946 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:52:22.421 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.404 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:56:25.877 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.409 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:56:25.882 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.431 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:56:25.906 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.434 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:56:25.909 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.452 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:56:25.927 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.452 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:56:25.927 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.547 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:56:26.022 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.551 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:56:26.026 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:56:18.580 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:56:26.053 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.923 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:57:34.396 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.932 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:57:34.405 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.938 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:57:34.413 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.943 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:57:34.418 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.950 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:57:34.425 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:26.961 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:57:34.436 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:27.015 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:02:57:34.489 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:27.032 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:02:57:34.505 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T17:57:27.054 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:02:57:34.529 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.092 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:02:44.565 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.105 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:02:44.578 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.106 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:02:44.580 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.109 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:02:44.584 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.113 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:02:44.588 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.117 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:02:44.591 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.301 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:02:44.775 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.323 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:02:44.798 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:02:37.358 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:02:44.831 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.327 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:03:42.799 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.334 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:03:42.807 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.350 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:03:42.822 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.362 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:03:42.836 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.376 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:03:42.851 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.389 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:03:42.864 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.395 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:03:42.867 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.438 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:03:42.912 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:03:35.451 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:03:42.926 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.639 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:04:48.112 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.644 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:04:48.117 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.651 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:04:48.125 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.652 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:04:48.127 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.684 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:04:48.159 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.686 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:04:48.161 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.702 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:04:48.177 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.720 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:04:48.193 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:04:40.730 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:04:48.205 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:05:09.343 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:09.344 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:11.707 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:12.001 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:12.001 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:19.507 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:19.507 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:20.125 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:20.524 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:20.524 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:27.514 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:28.078 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:34.478 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:35.165 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:35.468 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:35.468 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:41.700 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:41.700 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:42.244 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:42.562 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:49.210 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:49.210 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:50.362 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:50.605 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:57.139 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:57.140 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:05:58.120 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:05:58.421 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:05:58.421 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:04.500 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:04.500 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:05.440 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:05.745 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:05.746 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:11.895 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:12.334 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:12.557 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:12.557 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:19.182 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:19.182 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:19.594 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:19.876 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:19.877 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:26.360 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:26.360 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:26.841 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:27.081 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:27.081 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:33.239 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:33.239 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:33.975 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:33.975 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:39.582 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:39.582 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:40.170 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:40.936 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:40.936 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:49.484 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:49.485 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:50.223 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:06:50.662 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:50.662 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:06:59.620 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:06:59.620 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:00.104 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:00.590 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:00.590 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:08.340 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:08.341 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:09.286 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:09.586 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:09.586 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:20.276 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:20.276 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:21.233 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:21.482 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:21.483 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:30.394 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:30.394 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:30.971 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:31.327 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:31.327 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:39.491 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:39.491 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:40.070 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:40.345 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:49.353 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:49.353 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:49.378 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:07:56.850 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.390 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:07:56.863 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.402 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:07:56.877 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.403 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:07:56.878 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.409 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:07:56.882 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.416 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:07:56.888 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.550 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:07:57.024 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.560 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:07:57.029 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.574 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:07:57.048 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:07:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:07:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:50.157 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:59.279 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:07:59.279 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:07:59.753 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:00.044 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:00.044 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:08.951 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:08.951 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:09.372 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:09.589 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:09.589 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:16.543 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:16.543 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:16.902 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:17.138 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:17.138 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:24.473 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:24.474 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:25.915 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:26.234 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:26.234 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:33.843 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:35.183 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:35.699 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:41.233 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:41.233 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:42.184 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:42.430 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:42.430 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:48.858 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:48.859 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:49.308 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:08:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:08:49.658 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:08:57.375 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:01.179 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:09:01.180 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:09:01.180 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:01.180 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:09:06.125 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:06.125 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:09:06.636 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:09:06.957 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:06.957 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:09:44.494 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:44.495 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:09:48.108 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:09:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:09:48.387 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:24.626 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:24.626 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:27.984 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:10:28.530 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:28.530 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:38.030 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:38.030 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:38.388 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:10:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:38.670 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:46.525 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:46.962 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:10:47.412 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:47.412 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:55.297 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:55.297 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:10:55.775 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:10:56.069 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:10:56.070 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:04.824 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:04.824 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:05.598 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:05.956 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:05.956 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:12.960 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:12.960 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:14.023 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:14.282 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:14.282 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:22.641 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:22.642 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:23.475 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:23.720 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:23.720 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:32.619 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:32.619 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:33.414 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:33.651 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:33.651 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:40.398 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:41.199 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:41.958 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:41.959 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:49.277 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:49.277 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:51.302 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:58.104 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:58.104 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:11:58.493 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:11:58.744 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:11:58.744 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:04.980 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:09.243 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:10.027 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:10.027 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:12.900 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:12.900 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:14.719 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:14.719 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:25.434 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:25.434 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:29.999 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:30.266 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:30.266 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:31.899 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:31.900 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:33.184 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:33.184 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:33.789 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:34.098 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:34.098 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:35.953 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:35.953 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:37.122 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:44.088 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:44.090 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:44.090 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:44.091 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:44.091 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:44.091 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:44.499 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:44.499 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:45.390 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:45.986 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:45.987 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:46.219 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:46.481 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:46.482 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:46.980 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:46.980 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:47.336 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:47.638 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:47.638 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:50.507 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:51.748 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:12:52.136 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:52.136 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:54.282 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:54.454 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:54.454 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:55.514 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:55.514 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:55.753 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:55.753 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:55.925 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:56.114 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:56.115 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:56.115 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:57.279 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:57.279 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:57.500 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:57.501 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:57.756 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:57.756 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:58.564 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:58.565 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:58.898 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:59.254 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:59.254 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:12:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:12:59.632 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:00.283 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:00.284 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:00.729 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:01.368 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:01.369 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:01.433 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:08.906 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.444 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:08.917 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.454 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:08.929 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.457 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:08.932 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.458 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:08.933 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.471 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:08.945 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.543 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:01.544 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:01.653 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:09.127 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.700 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:09.174 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.779 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:09.252 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:01.873 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:02.096 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:02.096 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:02.612 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:02.612 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:02.870 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:10.344 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.870 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:10.345 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.899 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:13:10.374 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.908 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:10.383 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.909 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:10.384 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.918 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:13:10.393 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:02.996 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:02.996 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:03.479 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:10.952 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:03.481 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:10.954 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:03.496 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:13:10.969 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:13:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:03.617 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:03.798 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:03.799 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:04.073 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:04.073 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:04.356 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:04.357 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:05.139 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:05.139 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:05.304 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:05.743 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:05.743 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:06.268 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:06.269 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:06.495 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:07.196 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:07.380 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:07.380 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:07.724 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:07.724 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:08.140 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:08.141 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:08.750 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:08.750 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:09.091 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:09.091 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:09.416 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:09.634 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:09.634 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:10.293 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:10.293 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:10.633 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:10.633 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:10.910 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:10.910 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:11.173 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:11.173 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:11.472 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:11.472 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:11.815 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:11.815 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:12.071 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:12.071 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:12.621 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:12.621 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:12.888 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:12.888 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:13.300 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:13.300 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:13.553 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:13.553 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:14.667 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:14.667 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:21.131 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:23.463 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:23.463 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:23.464 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:23.464 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:23.464 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:24.184 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:24.185 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:31.247 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:31.493 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:31.493 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:33.764 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:33.764 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:34.413 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:34.413 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:36.377 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:36.377 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:36.582 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:37.026 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:37.026 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:42.900 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:42.901 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:48.283 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:13:48.559 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:48.559 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:13:54.726 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:13:54.726 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:02.842 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:02.842 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:05.785 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:05.785 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:07.576 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:07.928 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:07.929 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:10.449 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:10.449 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:12.493 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:12.493 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:14.167 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:14.167 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:17.272 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:17.715 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:17.715 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:20.403 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:20.404 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:22.655 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:22.880 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:25.409 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:25.409 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:32.593 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:34.470 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:34.470 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:36.278 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:36.556 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:36.556 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:39.038 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:39.039 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:40.400 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:40.639 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:40.639 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:43.477 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:44.943 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:44.943 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:47.678 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:47.919 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:47.919 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:50.800 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:53.312 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:53.608 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:53.609 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:55.658 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:55.658 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:14:59.484 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:14:59.818 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:14:59.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:02.232 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:02.232 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:04.144 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:04.456 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:04.457 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:07.379 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:07.380 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:09.305 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:09.609 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:09.610 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:12.191 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:12.191 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:15.163 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:15.164 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:15.494 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:16.074 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:16.074 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:19.536 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:19.536 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:21.143 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:21.463 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:21.463 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:24.085 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:24.967 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:25.323 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:25.640 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:27.924 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:27.924 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:29.708 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:29.708 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:32.243 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:32.243 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:33.899 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:37.456 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:37.456 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:45.293 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:50.404 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:53.384 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:53.384 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:54.570 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:54.570 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:54.848 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:55.304 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:55.304 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:57.337 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:57.338 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:15:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:15:58.576 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:15:58.577 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:00.511 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:00.511 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:01.939 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:02.198 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:04.534 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:04.534 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:06.296 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:06.297 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:06.767 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:07.211 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:10.166 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:10.166 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:13.802 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:14.336 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:14.776 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:16.786 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:16.786 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:17.633 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:18.026 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:18.026 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:21.483 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:21.484 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:23.171 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:23.494 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:25.450 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:25.450 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:25.603 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:26.432 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:26.432 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:29.548 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:29.548 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:29.894 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:30.219 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:30.219 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:32.754 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:32.755 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:33.486 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:33.486 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:36.502 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:37.125 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:37.415 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:41.039 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:41.039 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:42.990 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:42.991 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:43.360 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:43.655 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:43.655 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:46.830 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:46.830 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:47.345 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:51.292 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:51.292 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:51.983 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:51.983 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:53.940 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:53.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:55.031 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:55.450 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:55.451 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:58.821 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:58.822 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:16:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:16:59.784 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:16:59.784 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:02.341 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:03.111 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:03.404 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:03.404 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:06.314 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:06.314 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:06.665 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:06.957 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:06.957 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:09.641 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:09.642 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:10.093 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:10.369 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:10.369 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:14.069 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:14.070 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:14.480 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:14.694 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:17.153 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:17.154 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:17.395 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:17.649 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:20.042 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:20.043 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:20.765 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:21.067 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:21.068 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:23.608 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:24.212 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:24.579 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:24.580 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:27.124 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:27.124 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:27.449 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:28.094 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:30.515 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:30.515 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:32.798 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:33.050 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:33.050 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:35.582 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:46.538 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:46.539 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:46.540 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:46.541 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:46.883 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:46.884 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:49.297 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:49.297 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:52.613 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:52.613 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:54.685 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:17:54.983 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:54.983 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:17:58.093 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:17:58.094 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:01.376 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:01.376 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:01.876 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:01.877 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:03.896 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:05.772 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:06.221 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:08.714 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:08.714 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:10.352 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:10.569 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:10.569 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:13.159 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:13.160 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:13.699 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:18:21.171 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.720 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:18:21.192 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.724 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:18:21.199 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.727 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:18:21.201 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.727 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:18:21.201 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.732 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:18:21.207 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.928 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:18:21.403 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.948 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:18:21.423 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:13.971 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:18:21.444 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:18:16.308 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:16.843 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:16.844 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:19.317 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:19.317 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:22.492 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:22.879 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:22.879 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:24.836 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:28.117 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:28.420 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:28.420 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:31.071 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:31.071 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:32.837 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:33.095 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:33.095 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:35.261 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:35.261 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:40.118 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:40.423 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:40.424 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:43.890 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:43.890 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:47.048 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:47.315 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:47.315 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:50.177 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:50.177 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:52.275 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:52.572 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:52.572 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:55.253 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:18:57.271 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:18:57.500 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:18:57.501 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:00.906 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:01.555 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:02.122 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:02.122 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:05.921 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:05.922 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:10.588 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:10.588 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:10.908 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:11.203 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:11.203 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:14.807 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:14.807 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:19.859 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:19.859 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:20.369 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:27.695 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:27.695 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:27.695 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:27.695 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:28.539 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:28.540 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:29.178 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:29.555 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:31.989 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:31.989 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:32.262 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:32.508 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:32.508 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:35.719 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:35.719 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:43.638 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:43.911 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:43.912 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:47.837 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:48.707 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:49.166 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:54.206 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:54.206 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:54.671 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:55.011 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:55.011 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:59.388 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:59.388 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:19:59.612 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:19:59.837 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:19:59.837 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:03.168 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:03.169 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:03.420 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:04.222 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:04.223 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:07.960 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:07.960 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:08.540 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:08.835 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:08.835 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:13.281 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:13.281 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:13.772 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:14.044 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:14.044 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:17.637 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:23.079 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:23.792 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:23.792 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:28.174 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:28.175 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:31.122 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:31.122 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:34.664 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:34.665 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:35.213 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:35.610 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:35.611 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:39.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:40.317 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:40.587 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:40.587 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:44.768 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:44.768 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:44.898 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:45.300 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:45.300 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:49.355 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:49.355 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:49.890 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:51.896 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:51.897 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:53.514 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:53.514 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:54.169 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:20:54.454 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:54.455 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:57.004 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:57.005 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:20:58.477 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:20:58.477 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:00.191 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:00.455 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:03.716 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:03.716 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:04.469 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:04.685 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:04.685 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:07.325 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:07.326 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:09.404 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:09.405 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:09.517 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:09.740 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:10.825 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:11.090 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:11.090 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:11.988 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:12.238 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:12.238 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:12.896 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:13.127 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:13.127 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:13.849 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:13.849 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:20.094 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:20.373 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:20.373 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:23.267 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:23.738 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:23.739 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:24.424 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:21:31.897 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.462 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:21:31.936 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.463 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:21:31.938 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.483 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:21:31.956 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.520 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:21:31.994 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.522 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:21:31.996 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.542 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:21:32.017 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.596 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:21:32.068 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:24.648 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:21:32.122 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:21:25.487 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:25.487 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:27.569 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:27.819 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:27.820 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:30.320 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:30.954 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:30.954 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:33.502 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:33.873 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:33.874 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:39.221 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:39.222 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:42.321 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:42.654 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:42.654 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:45.371 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:45.615 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:49.041 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:49.041 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:50.560 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:53.934 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:53.934 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:55.779 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:21:55.982 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:55.982 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:21:59.492 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:21:59.492 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:03.196 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:03.196 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:06.309 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:06.309 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:07.849 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:08.077 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:10.768 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:10.768 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:13.532 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:13.533 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:16.072 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:16.073 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:19.556 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:19.861 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:19.861 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:21.209 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:21.209 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:23.581 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:23.897 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:23.897 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:26.964 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:26.964 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:28.368 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:28.368 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:31.782 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:32.830 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:32.831 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:34.091 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:34.408 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:34.408 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:36.066 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:36.066 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:37.541 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:37.835 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:37.835 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:40.472 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:40.473 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:42.875 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:43.138 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:43.138 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:45.896 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:45.896 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:49.769 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:50.096 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:52.885 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:52.886 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:55.650 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:55.915 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:55.915 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:57.568 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:57.568 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:22:59.552 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:22:59.775 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:22:59.775 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:02.057 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:02.058 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:06.286 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:06.533 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:06.533 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:09.315 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:09.316 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:09.799 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:09.799 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:10.931 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:11.058 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:11.637 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:11.637 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:13.638 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:13.638 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:14.941 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:14.942 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:15.270 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:15.270 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:17.564 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:17.564 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:18.394 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:18.395 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:19.799 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:19.800 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:20.305 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:20.305 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:20.819 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:20.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:21.243 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:21.244 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:21.350 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:21.728 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:21.729 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:24.194 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:24.194 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:24.669 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:24.669 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:26.115 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:23:33.588 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.152 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:23:33.624 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.155 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:23:33.630 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.160 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:23:33.634 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.176 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:23:33.650 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.179 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:23:33.653 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.250 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:23:33.724 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.269 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:23:33.743 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.278 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:23:33.750 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:23:26.504 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:26.505 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:26.917 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:26.917 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:27.305 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:27.305 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:27.708 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:27.843 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:28.055 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:28.055 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:30.410 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:30.410 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:31.103 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:31.104 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:32.781 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:32.781 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:33.163 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:33.163 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:33.713 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:33.713 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:35.132 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:35.133 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:35.372 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:35.670 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:35.671 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:38.405 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:38.405 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:39.087 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:39.087 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:40.514 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:40.514 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:40.984 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:40.984 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:41.412 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:41.412 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:41.834 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:41.834 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:43.336 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:43.586 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:43.587 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:46.192 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:46.192 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:46.597 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:46.597 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:46.924 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:47.152 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:47.152 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:49.258 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:49.258 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:52.335 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:52.335 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:52.698 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:52.699 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:56.141 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:23:56.377 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:56.377 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:23:58.929 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:23:58.929 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:00.172 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:00.712 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:00.712 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:03.353 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:03.354 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:05.937 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:06.274 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:06.379 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:09.591 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:09.591 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:10.245 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:10.245 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:12.440 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:12.730 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:12.730 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:15.783 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:15.783 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:16.432 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:16.432 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:17.127 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:17.128 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:19.384 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:19.384 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:22.717 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:22.953 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:22.953 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:25.277 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:25.278 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:30.775 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:30.775 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:32.196 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:32.196 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:33.140 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:33.582 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:36.074 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:41.373 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:43.205 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:43.205 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:43.607 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:43.608 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:43.730 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:44.280 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:44.280 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:47.799 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:47.799 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:52.625 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:53.390 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:54.632 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:54.632 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:54.901 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:24:55.188 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:55.188 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:24:59.189 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:24:59.189 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:04.133 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:04.133 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:04.935 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:04.935 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:06.010 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:06.010 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:06.301 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:25:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:06.565 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:09.823 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:09.824 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:16.121 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:16.121 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:16.950 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:16.950 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:17.771 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:17.771 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:18.013 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:25:18.506 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:18.506 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:20.911 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:20.912 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:27.924 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:27.924 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:29.051 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:29.998 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:25:29.998 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:25:30.278 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:25:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.145 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.148 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.148 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.149 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.149 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.149 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.149 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.150 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.150 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.150 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:00.150 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.150 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.151 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.151 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.151 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.151 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.151 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.152 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.152 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.152 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.152 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:00.152 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.153 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:00.153 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:00.153 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:01.999 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:02.000 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:02.923 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:02.923 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:04.361 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:04.361 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:05.319 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:05.551 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:05.551 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:07.756 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:07.756 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:12.506 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:12.507 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:19.952 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:19.952 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:23.291 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:23.291 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:27.781 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:27.781 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:34.931 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:35.365 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:35.366 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:38.546 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:38.547 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:42.657 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:42.657 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:26:49.420 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:26:49.675 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:26:49.675 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:02.844 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:02.844 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:04.288 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:04.288 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:05.480 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:05.941 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:05.942 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:06.950 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:07.645 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:07.915 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:08.323 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:08.323 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:10.218 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:10.219 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:13.140 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:13.140 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:21.376 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:21.705 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:21.705 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:23.611 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:26.052 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:26.052 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:34.320 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:34.549 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:34.549 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:36.491 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:36.891 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:36.891 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:39.381 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:39.785 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:39.785 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:47.432 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:47.432 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:48.341 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:50.923 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:50.923 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:27:53.024 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:27:53.300 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:27:53.300 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:11.822 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:11.822 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:12.578 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:12.579 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:28:30.655 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:30.655 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:39.997 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:28:47.469 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:39.999 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:28:47.472 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.034 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:28:47.508 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.037 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:28:47.512 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.060 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:28:47.534 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.095 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:28:47.569 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.190 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:28:47.663 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.287 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:28:47.761 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:40.330 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:28:47.804 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:28:41.298 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:41.298 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:41.859 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:41.860 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:42.174 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:28:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:42.433 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:46.863 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:46.863 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:51.679 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:28:51.897 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:51.898 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:54.573 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:54.573 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:28:58.998 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:28:59.387 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:28:59.388 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:02.396 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:02.396 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:05.600 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:05.861 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:08.188 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:08.188 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:10.799 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:10.799 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:13.688 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:14.982 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:16.608 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:16.913 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:19.753 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:19.753 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:22.743 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:22.743 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:27.142 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:27.471 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:30.651 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:30.652 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:34.600 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:35.167 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:35.168 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:39.396 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:39.396 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:40.865 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:40.865 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:42.863 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:42.863 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:44.065 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:46.011 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:46.275 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:46.275 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:46.393 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:29:53.866 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.436 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:29:53.908 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.453 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:29:53.927 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.453 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:29:53.928 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.458 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:29:53.933 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.468 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:29:53.942 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.515 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:29:53.987 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.515 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:29:53.988 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:46.523 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:29:53.997 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:29:48.169 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:48.169 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:51.399 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:51.399 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:53.672 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:53.672 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:29:54.371 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:54.372 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:29:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:29:57.169 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:01.684 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:01.685 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:04.787 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:04.787 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:11.129 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:30:11.490 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:11.490 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:14.740 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:14.740 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:18.999 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:22.502 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:27.298 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:30:27.524 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:30:27.514+0000 a0738700 -1 handle_data failed with exit code -32 2019-11-27T18:30:27.759 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:27.759 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:30.044 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:30.044 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:30.542 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:30:30.822 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:30.822 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:33.241 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:33.241 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:33.497 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:30:33.812 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:33.812 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:37.428 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:37.428 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:39.868 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:39.868 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:45.821 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:57.458 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:57.458 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:57.459 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:30:58.400 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:30:58.400 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:05.698 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:05.698 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:16.967 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:31:17.601 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:17.601 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:21.355 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:21.355 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:31.314 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:31:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:31.591 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:33.501 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:33.502 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:31:35.486 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:31:35.486 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:32:25.103 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:32:25.523 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:32:30.869 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:32:30.869 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:32:36.965 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:32:36.896+0000 d279c700 -1 handle_data failed with exit code -104 2019-11-27T18:33:38.240 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:33:38.240 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:33:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:33:41.073 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:34:22.476 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:34:22.476 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:41.507 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:35:42.200 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:42.200 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:44.043 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:45.688 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:45.688 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:45.978 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:35:46.323 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:46.324 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:48.925 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:48.925 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:53.758 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:53.758 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:35:56.532 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:35:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:35:56.827 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:00.112 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:00.112 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:12.197 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:12.198 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:15.017 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:15.017 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:19.762 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:19.762 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:24.330 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:24.330 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:24.847 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:24.847 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:25.922 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:36:25.882+0000 93f1f700 -1 handle_data failed with exit code -104 2019-11-27T18:36:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:36:27.240 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:27.241 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:29.776 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:29.777 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:31.762 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:31.762 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:36:35.289 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:35.290 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:38.060 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:38.060 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:40.172 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:40.172 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:36:43.127 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:36:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.168 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.170 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.170 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.171 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.172 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.173 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.173 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:25.173 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:25.173 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:37:20.269+0000 82efd700 -1 handle_data failed with exit code -104 2019-11-27T18:37:34.805 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:34.805 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:39.499 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:39.499 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:45.704 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:45.705 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:47.007 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:47.007 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:37:49.752 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:37:49.752 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:01.702 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:01.702 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:07.030 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:08.395 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:38:15.868 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.417 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:38:15.891 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.422 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:38:15.896 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.432 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:38:15.906 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.440 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:38:15.914 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.446 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:38:15.919 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.620 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:38:16.094 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.662 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:38:16.136 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:08.795 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:38:16.267 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:38:11.371 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:11.372 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:12.092 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:12.092 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:14.149 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:26.825 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:26.825 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:32.239 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:32.240 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:44.840 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:44.841 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:44.841 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:44.842 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:38:44.842 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:44.842 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:44.842 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:38:44.842 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:38:44.842 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:38:39.082+0000 d6fa5700 -1 handle_data failed with exit code -104 2019-11-27T18:39:03.524 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:39:10.996 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.530 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:39:11.003 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.582 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:39:11.056 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.586 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:39:11.060 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.596 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:39:11.070 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.602 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:39:11.076 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.620 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:39:11.093 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.633 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:39:11.107 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:03.665 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:39:11.139 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:39:48.832 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:39:48.832 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:40:25.539 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:40:26.283 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:40:26.745 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:40:26.745 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:41:33.705 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:41:33.705 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:41:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:41:34.759 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:10.508 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:42:10.737 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:10.737 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:13.105 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:15.246 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:15.246 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:15.699 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:17.249 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:17.249 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:35.598 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:35.598 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:42:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:42:56.414 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:43:20.803 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:43:20.803 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:43:22.020 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:43:22.020 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:43:39.071 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:43:39.072 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:43:39.812 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:43:39.812 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:43:40.754 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:43:40.716+0000 e0fb9700 -1 handle_data failed with exit code -104 2019-11-27T18:44:13.653 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:44:13.653 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:44:15.230 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:44:22.702 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.235 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:44:22.707 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.242 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:44:22.716 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.244 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:44:22.718 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.247 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:44:22.721 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.248 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:44:22.722 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.429 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:44:22.903 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.438 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:44:22.912 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:15.475 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:44:22.947 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:44:25.640 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:44:25.640 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:44:29.764 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:44:29.715+0000 4726d700 -1 handle_data failed with exit code -104 2019-11-27T18:44:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:44:30.932 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:44:31.741 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:44:31.742 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:44:32.943 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:44:32.907+0000 c1f7b700 -1 handle_data failed with exit code -104 2019-11-27T18:45:06.782 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:45:06.783 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:45:25.232 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:45:25.233 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:45:30.452 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:45:30.425+0000 a6f45700 -1 handle_data failed with exit code -104 2019-11-27T18:45:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:45:32.242 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:45:32.872 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:45:32.873 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:45:34.530 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:45:34.502+0000 aff57700 -1 handle_data failed with exit code -104 2019-11-27T18:46:07.482 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T18:46:13.176 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:46:13.176 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:46:13.176 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:46:13.176 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:46:31.122 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:46:38.594 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.126 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:46:38.598 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.192 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:46:38.666 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.193 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:46:38.667 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.195 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:46:38.669 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.199 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:46:38.673 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.217 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:46:38.690 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.284 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:46:38.758 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:46:31.290 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:46:38.763 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:47:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:47:27.054 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:48:04.883 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:48:04.883 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:48:05.864 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:48:05.864 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:48:06.688 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:48:06.671+0000 128848700 -1 handle_data failed with exit code -104 2019-11-27T18:49:18.859 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:49:18.860 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:49:20.216 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:49:20.216 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:49:21.178 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:49:21.054+0000 12403f700 -1 handle_data failed with exit code -104 2019-11-27T18:49:24.990 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:49:32.462 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.010 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:49:32.482 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.011 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:49:32.485 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.014 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:49:32.488 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.020 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:49:32.494 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.022 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:49:32.496 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.130 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:49:32.604 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.132 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:49:32.606 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:25.204 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:49:32.677 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:49:59.965 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:49:59.965 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:51:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:51:12.539 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:51:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:51:55.120 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:51:55.121 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:51:55.122 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:51:55.122 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:51:52.243+0000 f4fe1700 -1 handle_data failed with exit code -104 2019-11-27T18:52:47.378 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:52:47.379 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:52:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:52:48.339 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:52:49.207 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:52:49.175+0000 606b8700 -1 handle_data failed with exit code -104 2019-11-27T18:53:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:53:19.346 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:54:26.008 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:54:26.008 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:54:36.734 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:54:44.206 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.742 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:54:44.215 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.753 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:54:44.227 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.755 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:54:44.229 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.756 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:54:44.230 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.762 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:54:44.236 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.946 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:54:44.420 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.953 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:54:44.427 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:36.981 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:54:44.453 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.087 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:55:00.560 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.092 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:55:00.565 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.113 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:55:00.585 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.154 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:55:00.627 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.158 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:55:00.632 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.160 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:55:00.634 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.162 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:55:00.636 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.180 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:55:00.654 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:54:53.187 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:55:00.661 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:55:05.006 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:55:05.007 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:55:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:55:05.778 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:55:06.447 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:55:06.438+0000 11d832700 -1 handle_data failed with exit code -104 2019-11-27T18:56:10.950 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:56:10.951 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:56:11.839 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:56:11.839 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:56:12.533 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:56:12.490+0000 b8f69700 -1 handle_data failed with exit code -104 2019-11-27T18:56:49.478 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:56:49.479 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:58:05.145 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:58:05.145 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:58:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:58:40.781 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:58:43.615 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:58:43.615 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:58:44.636 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:58:44.592+0000 b6764700 -1 handle_data failed with exit code -104 2019-11-27T18:59:46.891 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:59:54.363 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:46.908 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:59:54.380 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:46.910 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:59:54.384 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:46.912 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:59:54.386 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:46.918 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:59:54.392 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:46.921 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:59:54.394 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:47.092 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:03:59:54.566 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:47.095 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:03:59:54.569 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:47.147 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:03:59:54.619 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T18:59:48.055 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:59:48.055 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:59:48.916 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T18:59:48.916 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T18:59:50.471 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T18:59:50.413+0000 128848700 -1 handle_data failed with exit code -104 2019-11-27T19:00:25.620 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:00:25.620 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:02:20.912 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:02:20.912 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:02:52.066 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:02:52.067 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:02:52.788 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:02:52.788 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:02:53.310 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T19:02:53.299+0000 f17da700 -1 handle_data failed with exit code -104 2019-11-27T19:03:15.074 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:03:22.546 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.111 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:03:22.585 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.112 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:03:22.586 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.127 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:03:22.599 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.158 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:03:22.631 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.173 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:03:22.647 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.202 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:03:22.676 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.268 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:03:22.740 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:15.277 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:03:22.750 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:03:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:03:45.473 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:03:46.513 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:03:46.513 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:03:46.982 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T19:03:46.930+0000 127846700 -1 handle_data failed with exit code -104 2019-11-27T19:04:21.152 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:04:21.523 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:04:21.523 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:04:24.233 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:04:24.233 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:04:35.105 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:04:35.105 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:04:38.023 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:04:38.023 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:04:55.563 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:05:03.035 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.578 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:05:03.052 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.579 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:05:03.052 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.580 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:05:03.052 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.582 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:05:03.056 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.584 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:05:03.058 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.649 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:05:03.123 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.696 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:05:03.170 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.707 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:05:03.179 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:04:55.752 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:04:55.752 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:05:14.096 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:05:14.097 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:05:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:05:42.134 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:06:35.019 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:06:35.398 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:06:35.398 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:06:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:06:37.910 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:06:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:06:59.899 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:03.140 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:08.709 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:08.709 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:12.074 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:12.074 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:13.038 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:26.062 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:26.062 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:41.069 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:41.069 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:41.933 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:41.933 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:07:55.456 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:07:55.456 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:08:11.940 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:08:11.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:08:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:08:13.105 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:08:28.929 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:08:28.930 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:08:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:08:44.432 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:08:45.257 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:08:45.257 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:09:06.137 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:09:06.138 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:09:27.882 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:09:27.883 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:09:28.950 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:09:28.951 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:09:54.784 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:09:54.784 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:10:07.564 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:10:15.036 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.575 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:10:15.042 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.581 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:10:15.054 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.583 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:10:15.057 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.584 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:10:15.058 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.587 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:10:15.061 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.701 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:10:07.701 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:10:07.761 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:10:15.235 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.765 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:10:15.238 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:07.772 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:10:15.244 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:10:08.444 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:10:08.445 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:10:31.959 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:10:32.297 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:10:32.298 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:10:35.421 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:10:35.422 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:11:00.712 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:11:00.712 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:11:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:11:02.022 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:11:02.022 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:11:04.526 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:11:04.526 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:11:36.930 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:11:44.401 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:36.932 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:11:44.405 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:36.935 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:11:44.407 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:36.973 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:11:44.446 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:36.975 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:11:44.449 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:36.986 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:11:44.460 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:37.035 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:11:44.509 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:37.059 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:11:44.532 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:11:37.164 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:11:44.636 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:12:07.860 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:12:08.175 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:12:08.175 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:12:11.250 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:12:11.251 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:12:49.806 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:12:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:12:50.036 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:12:52.248 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:12:52.248 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:11.437 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:11.437 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:13.619 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:13:14.051 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:14.051 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:16.941 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:16.941 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:18.787 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:13:19.135 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:19.135 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:21.708 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:21.708 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:30.480 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:43.743 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:43.743 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:13:59.338 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:13:59.338 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:04.357 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:14:04.621 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:04.621 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:07.859 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:07.859 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:14:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:12.778 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:16.102 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:16.102 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:21.183 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:14:21.448 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:21.448 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:27.213 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:14:27.450 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:27.451 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:29.427 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:29.427 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:33.162 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:14:33.402 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:33.402 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:35.365 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:35.365 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:40.327 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:40.327 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:41.211 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:41.211 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:42.921 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:42.921 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:43.847 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:43.847 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:45.216 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:45.216 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:46.536 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:46.537 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:47.771 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:47.771 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:49.019 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:49.019 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:51.191 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:51.191 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:52.372 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:52.372 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:53.625 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:55.067 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:55.067 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:56.006 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:56.482 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:56.482 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:57.994 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:57.994 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:58.643 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:58.644 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:14:59.257 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:14:59.258 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:00.135 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:00.135 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:01.514 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:01.514 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:02.384 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:02.958 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:02.958 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:03.798 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:03.798 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:04.176 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:04.177 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:05.187 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:05.188 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:05.593 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:05.593 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:06.946 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:06.946 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:07.355 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:07.356 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:08.037 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:08.038 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:09.413 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:09.414 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:09.987 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:09.987 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:11.027 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:11.027 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:11.763 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:12.631 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:12.631 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:13.270 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:15:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:13.493 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:15.997 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:15.997 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:19.340 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:15:26.812 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.358 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:15:26.830 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.363 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:15:26.836 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.368 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:15:26.842 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.368 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:15:26.842 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.372 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:15:26.845 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.542 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:15:27.016 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.558 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:15:27.030 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:19.571 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:15:27.045 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:15:21.146 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:21.147 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:22.303 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:22.303 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:23.828 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:15:24.051 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:24.051 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:27.827 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:27.827 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:33.322 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:33.322 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:33.804 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:15:34.066 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:34.066 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:36.976 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:36.976 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:39.582 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:39.583 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:45.380 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:45.380 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:47.153 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:15:47.745 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:47.745 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:51.341 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:15:59.300 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:15:59.300 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:08.289 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:08.289 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:13.346 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:16:13.586 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:13.586 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:17.293 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:17.293 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:33.609 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:49.319 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:49.319 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:16:59.306 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:16:59.765 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:16:59.765 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:03.495 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:03.495 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:04.704 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:04.705 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:07.307 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:07.307 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:09.568 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:09.568 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:13.407 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:13.408 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:14.992 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:17:15.283 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:15.283 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:17.600 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:17.600 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:23.910 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:23.910 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:29.555 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:38.330 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:38.330 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:46.533 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:46.533 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:51.744 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:17:52.420 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:52.420 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:17:55.494 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:17:55.494 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:18:09.360 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:18:09.360 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:18:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:18:19.250 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:18:38.724 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:18:38.724 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:18:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:18:50.818 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:00.733 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:19:01.486 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:01.486 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:05.357 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:05.357 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:11.363 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:11.363 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:15.502 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:15.503 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:18.180 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:19:18.465 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:18.466 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:22.342 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:22.342 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:44.471 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:44.471 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:51.367 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:19:51.767 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:51.768 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:54.380 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:19:54.380 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:19:58.904 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:06.375 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:58.916 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:06.387 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:58.929 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:06.403 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:58.937 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:06.410 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:58.953 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:06.427 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:58.955 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:06.429 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:59.048 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:06.521 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:59.073 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:06.546 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:19:59.085 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:06.557 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:20.238 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:20:20.238 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:20:31.558 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:39.030 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.562 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:39.034 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.564 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:39.038 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.568 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:39.042 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.570 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:39.044 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.572 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:39.046 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.616 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:20:39.089 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.639 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:20:39.113 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:31.686 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:20:39.158 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:20:42.713 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:20:42.713 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:20:55.127 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:20:55.425 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:20:55.426 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:20:58.464 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:20:58.465 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:01.071 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:01.071 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:03.336 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:03.336 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:07.320 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:07.321 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:09.458 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:21:09.936 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:09.936 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:14.360 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:14.361 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:20.274 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:21:20.534 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:20.534 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:22.924 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:22.924 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:33.954 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:33.955 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:41.144 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:41.145 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:42.046 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:21:42.311 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:42.311 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:45.207 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:47.422 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:21:47.737 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:47.737 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:21:51.613 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:21:51.614 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:12.177 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:12.568 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:14.979 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:14.979 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:16.599 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:16.850 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:16.850 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:20.000 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:21.830 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:22.247 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:24.489 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:24.489 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:25.902 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:26.226 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:26.226 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:28.940 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:28.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:31.356 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:31.584 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:31.584 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:34.642 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:34.643 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:35.127 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:35.127 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:36.699 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:36.699 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:37.735 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:37.735 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:39.645 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:39.645 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:40.530 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:22:41.107 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:41.107 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:22:43.357 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:22:43.358 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:25:35.338 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:42.810 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.347 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:42.819 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.465 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:42.934 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.466 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:42.938 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.466 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:42.938 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.482 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:42.956 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.560 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:43.031 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.656 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:43.130 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:35.676 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:43.150 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.601 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:49.073 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.612 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:49.084 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.618 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:49.092 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.619 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:49.092 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.622 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:49.096 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.623 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:49.097 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.644 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:25:49.118 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.653 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:25:49.126 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:25:41.663 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:25:49.135 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:27:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:27:39.273 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:27:39.273 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:27:42.163 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:27:42.163 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:21.089 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:28:28.560 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.090 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:28:28.562 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.155 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:28:28.629 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.164 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:28:28.637 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.167 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:28:28.641 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.177 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:28:28.650 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.193 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:28:28.665 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.254 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:28:28.727 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:21.269 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:28:28.742 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:28:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:28:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:35.968 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:38.126 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:38.126 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:38.800 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:38.800 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:41.291 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:28:49.412 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:49.412 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:51.562 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:51.563 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:52.330 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:52.330 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:28:53.530 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:28:53.530 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:12.442 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:29:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:12.702 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:15.533 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:15.533 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:15.912 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:15.912 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:17.490 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:17.490 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:19.476 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:30.001 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:29:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:30.453 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:33.280 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:33.280 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:35.265 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:35.265 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:29:56.497 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:29:56.497 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:30:24.077 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:30:24.077 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:30:53.814 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:31:01.286 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.820 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:31:01.292 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.822 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:31:01.296 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.824 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:31:01.298 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.827 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:31:01.301 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.828 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:31:01.302 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.963 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:31:01.436 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:53.974 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:31:01.448 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:30:54.009 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:31:01.481 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:31:32.597 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:31:32.871 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:31:32.871 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:31:35.479 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:31:35.479 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:31:37.904 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:31:37.905 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:33:19.877 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:33:20.098 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:33:20.098 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:33:22.069 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:33:22.069 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:33:23.210 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:33:23.211 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:36:05.875 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:13.347 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:05.883 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:13.355 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:05.893 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:13.367 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:05.896 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:13.369 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:05.900 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:13.374 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:05.900 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:13.374 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:06.076 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:13.550 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:06.109 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:13.583 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:06.118 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:13.590 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.946 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:50.418 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.951 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:50.422 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.983 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:50.457 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.986 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:50.460 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.987 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:50.461 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:42.990 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:50.464 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:43.012 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:36:50.486 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:43.028 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:36:50.502 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:36:43.068 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:36:50.540 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:41:16.060 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:41:16.061 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:41:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:41:19.029 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:41:20.060 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:41:27.531 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.068 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:41:27.540 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.086 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:41:27.560 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.097 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:41:27.564 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.097 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:41:27.570 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.098 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:41:27.570 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.307 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:41:27.780 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.317 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:41:27.791 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.347 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:41:27.817 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:41:20.523 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:41:20.523 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:42:21.213 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:42:21.213 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:43:10.161 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:43:10.161 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:44:03.310 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:44:03.310 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:45:09.731 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:45:17.203 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.742 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:45:17.214 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.777 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:45:17.251 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.791 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:45:17.265 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.798 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:45:17.272 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.803 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:45:17.276 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.873 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:45:17.345 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.887 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:45:17.361 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:45:09.924 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:45:17.393 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.721 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:46:41.192 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.743 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:46:41.214 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.743 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:46:41.217 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.748 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:46:41.221 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.749 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:46:41.222 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.757 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:46:41.227 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.821 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:46:41.295 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.831 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:46:41.305 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:46:33.850 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:46:41.322 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:47:27.659 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:47:28.165 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:47:28.166 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:47:30.819 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:47:30.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:47:32.104 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:47:32.105 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:13.410 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:48:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:13.646 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:16.701 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:18.476 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:18.476 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:43.778 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:43.778 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:55.616 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:48:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:55.898 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:48:59.535 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:48:59.535 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:02.155 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:02.155 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:21.503 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:49:21.819 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:21.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:23.710 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:23.710 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:24.883 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:24.884 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:51.819 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:49:52.096 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:52.096 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:54.394 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:54.394 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:55.940 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:55.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:49:58.255 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:49:58.610 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:49:58.610 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:02.387 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:04.051 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:04.051 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:22.843 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:50:23.097 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:23.097 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:26.020 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:26.020 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:27.954 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:41.871 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:41.871 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:43.777 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:50:44.199 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:44.199 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:46.388 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:48.057 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:48.057 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:48.176 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:48.177 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:48.425 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:48.426 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:49.017 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:49.018 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:49.216 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:50:49.217 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:50:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-51: 2019-11-27T19:50:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:50:50.705 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:50:50.706 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:50:51.430 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-53: 2019-11-27T19:50:51.431 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:50:51.431 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:50:51.431 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:50:51.431 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:50:51.432 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:50:51.432 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:50:51.432 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:50:51.432 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:50:51.433 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:50:51.433 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:50:51.433 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:50:51.433 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:50:51.434 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-54: 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:50:51.603 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:50:51.604 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:50:51.605 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:50:51.607 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-55: 2019-11-27T19:50:51.607 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:50:51.607 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:50:51.608 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:50:51.609 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:50:51.609 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:50:51.609 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:50:51.609 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-62: 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:05.738 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:05.739 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:05.740 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:05.794 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-64: 2019-11-27T19:51:05.794 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:05.794 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:05.794 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:05.795 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:05.796 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:05.796 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:05.796 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-65: 2019-11-27T19:51:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:05.841 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:05.842 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:05.843 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:05.843 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:05.843 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:05.843 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:06.569 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-63: 2019-11-27T19:51:06.569 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:06.569 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:06.569 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:06.570 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:06.571 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:06.571 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:06.571 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:21.266 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-75: 2019-11-27T19:51:21.266 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:21.266 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:21.266 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:21.267 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:21.268 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:21.268 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:21.268 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-71: 2019-11-27T19:51:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:21.306 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:21.307 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:21.309 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-73: 2019-11-27T19:51:21.309 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:21.309 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:21.309 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:21.310 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:21.311 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:21.311 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-74: 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:21.436 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:21.437 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:21.438 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-81: 2019-11-27T19:51:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:34.908 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:34.909 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:34.909 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:34.909 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:34.909 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:34.910 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:35.112 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-85: 2019-11-27T19:51:35.112 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:35.113 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:35.113 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:35.113 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:35.113 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:35.113 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:35.114 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:35.114 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:35.114 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:35.114 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:35.115 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:35.115 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:35.115 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:35.125 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-84: 2019-11-27T19:51:35.125 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:35.125 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:35.126 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:35.126 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:35.126 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:35.126 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:35.127 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:35.127 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:35.127 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:35.127 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:35.128 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:35.128 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:35.333 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-82: 2019-11-27T19:51:35.333 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:35.334 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:35.334 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:35.334 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:35.334 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:35.334 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:35.335 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:46.396 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:51:53.867 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.406 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:51:53.878 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.412 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:51:53.886 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.418 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:51:53.892 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.419 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:51:53.893 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.422 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:51:53.896 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.598 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:51:54.072 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.664 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:51:54.126 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:46.691 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:51:54.162 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:51:49.368 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-95: 2019-11-27T19:51:49.368 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:49.370 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:49.370 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:49.370 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-93: 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:49.449 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:49.450 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:49.451 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-91: 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:49.938 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:49.940 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:51:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-94: 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:51:50.670 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:51:50.671 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:52:02.299 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:02.617 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:02.617 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:04.781 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:04.781 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:06.504 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:06.866 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:06.866 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:07.116 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:07.116 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:07.454 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:07.454 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:08.309 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:08.309 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:08.654 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:08.655 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:09.157 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:09.158 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:09.670 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:09.670 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:09.888 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:09.889 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:10.153 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:11.267 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:11.267 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:11.268 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-102: 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:52:12.265 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:52:12.266 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:52:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-101: 2019-11-27T19:52:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:52:12.291 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:52:12.292 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:52:12.292 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:52:12.292 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:52:12.292 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:52:12.292 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:52:12.996 INFO:teuthology.orchestra.run.smithi156.stderr:Exception in thread Thread-104: 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: self.run() 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-27T19:52:12.997 INFO:teuthology.orchestra.run.smithi156.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr: raise error_class(parsed_response, operation_name) 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-27T19:52:12.998 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T19:52:27.499 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:27.832 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:27.832 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:29.679 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:29.679 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:31.506 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:32.012 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:32.012 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:34.129 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:34.129 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:37.086 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:37.313 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:39.750 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:39.750 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:42.685 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:42.937 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:42.937 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:45.412 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:45.412 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:45.833 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:46.114 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:46.114 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:48.605 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:48.606 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:48.815 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:49.244 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:49.245 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:51.529 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:51.529 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:52.118 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:52.506 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:55.025 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:55.025 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:57.313 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:52:57.610 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:57.610 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:52:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:52:59.847 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:00.069 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:00.389 INFO:teuthology.orchestra.run.smithi156.stderr:Check for valid x-amz-expiration header after PUT ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:00.389 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:03.221 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:03.221 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:06.717 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:07.005 INFO:teuthology.orchestra.run.smithi156.stderr:Check for valid x-amz-expiration header on HEAD request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:07.005 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:09.324 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:09.324 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:12.703 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:13.094 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:13.373 INFO:teuthology.orchestra.run.smithi156.stderr:Check for valid x-amz-expiration header on GET request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:13.374 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:15.437 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:24.891 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:25.457 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:25.694 INFO:teuthology.orchestra.run.smithi156.stderr:Check x-amz-expiration-header object tags interaction ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:25.695 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:28.597 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:28.597 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:31.709 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:53:39.177 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.736 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:53:39.210 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.736 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:53:39.208 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.747 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:53:39.221 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.764 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:53:39.238 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.764 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:53:39.239 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.804 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:53:39.276 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.834 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:53:39.308 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:31.838 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:53:39.312 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:53:33.617 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:33.828 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:33.829 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:38.588 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:40.139 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:42.577 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:42.577 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:43.860 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:44.113 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:44.114 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:45.885 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:45.886 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:48.113 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:48.370 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:50.806 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:52.769 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:52.769 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:55.158 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:55.158 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:57.518 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:53:57.805 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:57.805 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:53:59.932 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:53:59.933 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:02.181 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:02.436 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:02.436 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:05.223 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:05.223 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:07.402 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:07.851 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:07.851 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:10.697 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:10.697 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:15.479 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:15.903 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:15.903 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:19.198 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:19.198 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:21.716 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:22.017 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:22.017 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:24.961 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:24.961 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:27.814 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:27.814 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:31.029 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:33.346 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:33.720 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:33.721 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:37.689 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:37.689 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:39.501 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:39.940 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:42.969 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:43.130 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:43.523 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:43.524 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:46.018 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:46.018 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:46.161 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:46.381 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:46.382 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:51.063 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:51.533 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:51.775 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:51.775 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:54.460 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:54.461 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:54.667 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:54:55.003 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:55.003 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:54:57.388 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:54:57.388 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:56:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:56:50.689 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:56:57.580 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:57:05.052 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.596 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:57:05.068 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.598 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:57:05.072 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.600 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:57:05.074 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.602 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:57:05.076 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.607 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:57:05.079 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.729 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:04:57:05.202 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.735 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:04:57:05.209 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T19:56:57.836 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:04:57:05.308 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T19:58:03.864 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:58:03.864 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:58:40.780 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T19:58:41.033 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:58:41.034 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T19:58:43.493 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T19:58:43.494 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:01.637 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:01.637 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:02.608 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:02.608 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:05.596 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:05.596 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:08.400 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:08.400 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:08.647 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:08.904 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:08.905 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:12.415 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:12.415 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:15.069 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:15.461 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:18.320 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:18.320 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:20.559 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:20.821 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:20.822 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:23.510 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:23.511 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:24.686 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:24.686 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:26.818 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:26.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:27.020 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:00:27.294 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:27.294 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:00:30.222 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:00:30.222 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:01:53.578 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:01.049 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.585 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:01.057 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.624 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:01.098 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.625 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:01.100 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.634 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:01.108 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.637 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:01.112 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.751 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:01.224 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.757 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:01.231 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:01:53.850 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:01.322 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.755 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:14.226 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.768 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:14.240 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.771 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:14.245 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.777 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:14.251 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.781 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:14.255 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.786 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:14.260 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.815 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:02:14.289 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.826 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:02:14.298 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:06.828 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:02:14.302 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:02:15.500 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:02:15.501 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:02:17.119 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:02:17.119 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:03:10.232 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:03:10.232 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:03:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:03:11.689 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:03:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:03:45.923 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:03:45.923 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:03:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:03:47.843 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:04:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:04:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:04:51.124 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:04:54.469 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:04:54.470 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:00.395 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:00.802 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:00.802 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:03.677 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:05.129 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:05.129 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:05.625 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:05.859 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:09.603 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:09.604 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:11.116 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:11.661 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:11.662 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:14.235 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:14.235 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:16.040 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:16.040 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:18.921 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:18.921 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:22.685 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:22.924 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:22.925 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:25.027 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:26.595 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:26.866 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:26.866 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:29.064 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:29.064 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:30.512 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:30.803 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:30.803 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:34.177 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:36.649 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:36.649 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:39.496 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:40.086 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:40.086 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:43.193 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:43.194 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:44.912 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:06:52.384 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:44.929 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:06:52.401 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:44.979 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:06:52.453 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:44.990 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:06:52.464 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:44.991 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:06:52.466 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:45.005 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:06:52.479 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:45.126 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:06:52.597 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:45.169 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:06:52.643 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:45.204 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:06:52.678 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:06:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:45.297 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:45.825 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:46.100 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:46.100 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:49.236 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:49.236 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:53.030 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:53.031 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:55.569 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:06:55.860 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:55.861 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:06:58.507 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:06:58.507 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:02.595 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:02.595 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:04.809 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:07:05.088 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:05.088 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:07.949 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:07.950 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:11.073 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:11.073 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:16.949 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:16.949 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:18.024 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:18.024 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:18.312 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:07:18.534 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:18.535 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:18.903 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:07:26.375 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.915 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:07:26.387 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.916 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:07:26.390 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.920 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:07:26.394 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.920 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:07:26.394 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.923 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:07:26.398 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.962 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:07:26.436 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.981 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:07:26.455 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:18.994 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:07:26.465 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:07:21.039 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:21.039 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:25.293 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:25.293 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:31.705 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:31.706 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:32.841 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:32.841 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:33.355 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:07:34.040 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:34.040 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:36.305 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:36.305 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:47.809 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:47.809 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:49.103 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:07:49.322 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:49.323 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:07:51.399 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:07:51.400 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:06.365 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:06.366 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:08:09.373 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:09.374 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:12.264 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:24.309 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:24.309 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:26.093 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:08:26.581 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:26.581 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:30.009 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:30.009 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:41.941 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:41.941 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:42.514 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:08:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:42.861 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:45.722 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:45.722 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:08:59.115 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:08:59.116 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:00.923 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:09:01.374 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:01.374 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:03.741 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:03.742 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:15.624 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:15.624 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:16.452 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:09:16.851 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:16.852 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:20.549 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:32.773 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:32.773 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:33.636 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:09:34.029 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:34.029 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:36.597 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:36.597 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:47.871 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:47.871 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:09:51.452 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:51.453 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:09:53.165 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:09:53.166 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:03.444 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:03.444 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:06.004 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:06.300 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:06.300 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:09.467 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:09.468 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:12.928 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:12.928 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:15.505 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:15.505 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:15.824 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:10:23.296 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.833 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:10:23.305 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.908 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:10:23.383 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.909 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:10:23.383 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.911 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:10:23.385 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.913 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:10:23.387 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:15.980 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:10:23.452 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:16.010 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:10:23.484 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:16.018 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:10:23.492 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:10:16.878 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:16.878 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:17.157 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:17.412 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:17.412 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:19.819 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:21.623 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:21.833 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:21.833 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:24.349 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:24.349 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:35.566 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:35.566 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:38.085 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:38.086 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:38.826 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:39.078 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:39.078 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:41.477 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:41.477 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:53.138 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:55.113 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:55.113 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:10:57.211 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:10:57.449 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:10:57.449 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:01.135 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:13.675 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:16.255 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:17.792 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:11:18.152 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:18.153 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:20.917 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:20.917 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:22.609 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:22.610 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:27.323 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:27.324 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:30.354 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:32.884 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:32.884 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:11:35.620 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:35.621 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:39.199 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:39.200 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:11:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:11:41.291 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:12:29.023 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:12:36.495 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.026 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:12:36.501 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.036 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:12:36.507 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.039 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:12:36.511 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.040 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:12:36.515 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.050 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:12:36.524 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.152 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:12:36.624 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.188 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:12:36.662 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:29.204 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:12:36.678 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:12:41.109 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:12:41.109 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:13:40.035 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:13:40.035 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:13:41.950 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:13:41.951 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:14:57.054 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:14:57.305 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:14:57.306 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:04.019 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:04.019 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:08.880 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:08.881 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:09.524 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:09.524 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:10.692 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:15:10.924 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:10.924 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:17.180 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:17.180 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:21.034 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:21.035 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:23.033 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:15:23.252 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:23.252 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:29.058 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:29.058 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:33.492 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:33.492 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:36.383 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:15:36.786 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:36.786 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:43.357 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:43.358 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:45.149 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:45.150 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:49.727 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:15:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:15:55.917 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:15:55.918 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:00.613 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:00.613 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:01.549 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:01.549 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:05.373 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:05.373 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:08.186 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:08.430 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:08.431 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:11.858 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:11.858 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:13.913 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:15.272 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:15.567 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:15.568 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:18.356 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:18.356 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:21.210 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:21.210 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:24.397 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:24.398 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:28.532 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:28.823 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:28.823 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:37.006 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:37.006 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:42.965 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:45.330 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:45.598 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:51.705 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:51.953 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:51.953 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:54.436 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:54.662 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:54.662 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:16:57.428 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:16:57.781 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:16:57.781 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:00.690 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:00.924 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:00.924 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:03.977 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:04.207 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:04.207 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:06.914 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:07.318 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:07.318 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:11.218 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:11.644 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:11.644 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:16.360 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:16.879 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:16.880 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:19.621 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:19.621 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:31.771 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:32.263 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:36.718 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:36.957 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:42.499 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:17:49.970 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.505 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:17:49.977 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.520 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:17:49.994 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.527 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:17:50.002 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.536 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:17:50.010 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.541 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:17:50.015 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.714 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:17:50.188 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.759 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:17:50.231 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:42.775 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:17:50.249 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:17:44.017 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:44.345 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:17:58.335 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:17:58.600 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:17:58.600 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:18:02.917 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:18:03.515 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:18:03.515 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:18:18.670 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:18:19.116 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:18:19.116 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:18:30.186 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:18:30.491 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:18:30.492 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:18:37.622 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:18:45.094 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.660 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:18:45.132 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.673 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:18:45.147 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.678 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:18:45.153 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.681 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:18:45.156 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.685 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:18:45.159 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.718 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:18:45.192 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.722 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:18:45.194 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:37.742 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:18:45.216 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:18:43.283 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:18:43.566 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:18:43.566 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:18:56.870 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:18:57.243 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:18:57.243 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:12.071 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:12.340 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:12.341 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:24.245 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:24.605 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:24.606 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:32.155 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:32.452 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:32.453 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:36.486 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:36.945 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:36.945 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:43.624 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:43.879 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:43.880 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:54.309 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:19:54.684 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:19:54.684 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:19:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:20:00.125 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:20:00.125 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:20:07.199 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:20:07.458 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:20:07.458 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:20:20.288 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:20:20.531 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:20:20.531 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:20:40.081 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:20:40.333 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:20:40.333 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:20:52.610 INFO:teuthology.orchestra.run.smithi156.stderr:ok 2019-11-27T20:20:52.661 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-27T20:20:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T20:20:52.978 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T20:22:53.672 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:23:01.144 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.691 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:23:01.159 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.691 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:23:01.165 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.691 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:23:01.148 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.692 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:23:01.167 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.694 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:23:01.169 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.833 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:23:01.307 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.856 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:23:01.325 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:22:53.856 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:23:01.326 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.593 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:27:07.060 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.608 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:27:07.065 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.634 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:27:07.108 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.636 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:27:07.111 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.641 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:27:07.115 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.643 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:27:07.118 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.711 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:27:07.183 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.739 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:27:07.211 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:26:59.745 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:27:07.219 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.598 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:28:12.070 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.609 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:28:12.081 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.625 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:28:12.099 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.634 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:28:12.108 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.638 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:28:12.112 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.644 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:28:12.118 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.706 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:28:12.178 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.730 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:28:12.203 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:28:04.730 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:28:12.204 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.375 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:33:23.847 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.389 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:33:23.859 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.391 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:33:23.865 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.391 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:33:23.866 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.399 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:33:23.874 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.401 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:33:23.875 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.565 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:33:24.039 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.585 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:33:24.060 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:33:16.640 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:33:24.112 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.499 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:38:35.971 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.523 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:38:35.998 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.525 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:38:35.998 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.526 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:38:36.001 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.532 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:38:36.007 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.533 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:38:36.008 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.711 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:38:36.185 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.759 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:38:36.234 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:38:28.797 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:38:36.269 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.568 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:46.041 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.583 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:46.055 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.589 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:46.064 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.593 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:46.068 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.595 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:46.070 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.596 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:46.072 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.790 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:46.265 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.816 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:46.289 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:38.867 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:46.342 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.502 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:55.975 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.539 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:56.011 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.543 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:56.018 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.554 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:56.029 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.559 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:56.033 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.566 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:56.041 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.580 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:43:56.053 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.581 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:43:56.056 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:43:48.590 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:43:56.065 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.625 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:47:32.098 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.839 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:47:32.160 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.839 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:47:32.162 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.839 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:47:32.202 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.839 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:47:32.209 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.839 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:47:32.106 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.840 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:47:32.253 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.846 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:47:32.321 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:47:24.955 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:47:32.430 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.159 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:48:58.632 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.169 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:48:58.641 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.181 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:48:58.654 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.181 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:48:58.656 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.183 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:48:58.658 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.187 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:48:58.662 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.260 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:48:58.734 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.264 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:48:58.739 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:48:51.281 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:48:58.752 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.776 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:52:18.249 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.788 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:52:18.261 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.841 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:52:18.316 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.848 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:52:18.323 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.872 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:52:18.347 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.875 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:52:18.351 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.963 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:52:18.439 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.966 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:52:18.442 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:52:10.988 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:52:18.461 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.491 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:54:09.964 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.504 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:54:09.976 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.509 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:54:09.984 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.513 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:54:09.988 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.514 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:54:09.990 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.520 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:54:09.995 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.646 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:54:10.121 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.648 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:54:10.123 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:54:02.684 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:54:10.157 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.585 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:59:22.060 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.588 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:59:22.063 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.589 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:59:22.063 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.590 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:59:22.066 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.593 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:59:22.068 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.621 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:59:22.094 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.767 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:05:59:22.243 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.770 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:05:59:22.246 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T20:59:14.887 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:05:59:22.360 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.769 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:00:40.242 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.774 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:00:40.247 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.813 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:00:40.288 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.838 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:00:40.314 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.843 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:00:40.318 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.845 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:00:40.321 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.866 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:00:40.339 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.905 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:00:40.380 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:00:32.919 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:00:40.388 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.752 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:04:32.225 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.767 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:04:32.234 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.774 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:04:32.250 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.776 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:04:32.252 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.780 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:04:32.256 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.783 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:04:32.259 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.935 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:04:32.411 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.956 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:04:32.432 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:04:24.992 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:04:32.466 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.581 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:02.055 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.604 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:02.077 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.618 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:02.093 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.641 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:02.112 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.641 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:02.116 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.642 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:02.118 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.742 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:02.218 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.745 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:02.221 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:08:54.838 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:02.312 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.064 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:42.538 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.082 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:42.556 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.086 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:42.562 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.087 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:42.563 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.090 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:42.566 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.092 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:42.568 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.148 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:09:42.623 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.154 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:09:42.630 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:09:35.192 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:09:42.666 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.178 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:14:56.652 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.263 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:14:56.674 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.263 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:14:56.680 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.263 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:14:56.683 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.263 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:14:56.688 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.263 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:14:56.667 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.412 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:14:56.888 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.427 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:14:56.901 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:14:49.445 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:14:56.921 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.495 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:17:23.969 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.535 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:17:24.011 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.540 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:17:24.015 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.543 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:17:24.017 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.574 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:17:24.050 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.582 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:17:24.058 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.608 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:17:24.083 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.646 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:17:24.122 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:17:16.672 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:17:24.146 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.299 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:20:08.773 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.310 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:20:08.784 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.316 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:20:08.792 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.323 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:20:08.799 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.327 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:20:08.803 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.332 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:20:08.808 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.438 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:20:08.914 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.442 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:20:08.918 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:20:01.507 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:20:08.981 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.497 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:18.971 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.515 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:18.988 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.516 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:18.989 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.516 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:18.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.521 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:18.997 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.525 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:19.002 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.704 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:19.177 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.717 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:19.193 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:11.770 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:19.244 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.510 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:45.984 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.552 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:46.026 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.572 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:46.048 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.578 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:46.054 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.579 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:46.055 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.580 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:46.056 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.611 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:25:46.087 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.615 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:25:46.091 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:25:38.643 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:25:46.117 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.466 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:28:26.940 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.468 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:28:26.943 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.549 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:28:27.025 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.550 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:28:27.027 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.564 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:28:27.041 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.566 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:28:27.042 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.607 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:28:27.082 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.662 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:28:27.138 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:28:19.675 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:28:27.151 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.741 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:30:29.215 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.758 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:30:29.234 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.759 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:30:29.234 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.761 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:30:29.237 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.768 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:30:29.244 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.775 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:30:29.251 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.858 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:30:29.334 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.871 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:30:29.347 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:30:21.889 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:30:29.364 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.710 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:34:08.184 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.721 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:34:08.195 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.754 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:34:08.231 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.758 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:34:08.235 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.772 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:34:08.243 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.772 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:34:08.243 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.855 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:34:08.329 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.860 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:34:08.334 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:34:00.867 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:34:08.343 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.817 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:35:41.291 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.831 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:35:41.306 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.837 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:35:41.313 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.838 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:35:41.315 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.840 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:35:41.317 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.843 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:35:41.319 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.909 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:35:41.385 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.930 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:35:41.407 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:35:33.933 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:35:41.407 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.856 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:40:52.329 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.873 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:40:52.348 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.874 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:40:52.340 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.875 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:40:52.352 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.877 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:40:52.354 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:44.880 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:40:52.356 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:45.061 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:40:52.537 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:45.065 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:40:52.542 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:40:45.081 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:40:52.556 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.480 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:42:29.954 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.513 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:42:29.990 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.517 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:42:29.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.521 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:42:29.995 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.539 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:42:30.015 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.539 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:42:30.016 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.590 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:42:30.064 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.596 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:42:30.073 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:42:22.615 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:42:30.092 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.413 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:46:03.888 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.422 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:46:03.897 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.424 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:46:03.901 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.429 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:46:03.906 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.432 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:46:03.909 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.436 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:46:03.913 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.573 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:46:04.049 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.583 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:46:04.057 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:45:56.591 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:46:04.067 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.459 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:50:51.933 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.488 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:50:51.962 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.517 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:50:51.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.528 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:50:52.005 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.532 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:50:52.008 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.532 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:50:52.008 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.644 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:50:52.119 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.668 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:50:52.143 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:50:44.678 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:50:52.154 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.339 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:51:15.813 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.344 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:51:15.818 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.356 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:51:15.833 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.357 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:51:15.833 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.361 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:51:15.837 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.362 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:51:15.838 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.397 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:51:15.873 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.406 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:51:15.880 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:51:08.414 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:51:15.890 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.857 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:56:28.332 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.869 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:56:28.342 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.876 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:56:28.353 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.879 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:56:28.356 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.882 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:56:28.359 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:20.884 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:56:28.360 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:21.075 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:56:28.552 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:21.099 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:56:28.573 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:56:21.109 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:56:28.585 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.461 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:59:13.935 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.479 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:59:13.941 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.510 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:59:13.987 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.512 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:59:13.989 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.527 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:59:14.003 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.547 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:59:14.024 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.628 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:06:59:14.105 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.651 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:06:59:14.128 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T21:59:06.788 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:06:59:14.262 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.837 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:01:36.312 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.845 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:01:36.318 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.851 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:01:36.327 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.852 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:01:36.329 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.856 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:01:36.332 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.858 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:01:36.335 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.954 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:01:36.427 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.996 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:01:36.453 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:01:28.998 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:01:36.474 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:02:35.583 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T22:02:35.693 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T22:02:45.270 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi156.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-27T22:02:45.270 INFO:teuthology.orchestra.run.smithi156.stderr: SubjectAltNameWarning, 2019-11-27T22:02:46.894 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-27T22:02:46.901 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-27T22:02:46.902 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-27T22:02:46.902 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-27T22:02:46.902 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-27T22:02:46.902 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-27T22:02:46.902 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-27T22:02:47.279 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-27T22:02:47.476 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-27T22:02:47.825 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-27T22:02:47.849 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-27T22:02:47.868 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-27T22:02:47.868 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-27T22:02:47.869 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-27T22:02:47.870 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-27T22:02:47.870 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-27T22:02:47.875 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-27T22:02:47.875 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-27T22:02:47.875 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-27T22:02:47.876 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-27T22:02:47.881 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-27T22:02:47.881 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-27T22:02:47.881 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-27T22:02:47.882 INFO:teuthology.orchestra.run.smithi156.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-27T22:02:47.905 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-27T22:02:47.927 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-27T22:02:47.927 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-27T22:02:48.072 INFO:teuthology.orchestra.run.smithi156.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-27T22:02:48.072 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T22:02:48.072 INFO:teuthology.orchestra.run.smithi156.stderr:---------------------------------------------------------------------- 2019-11-27T22:02:48.073 INFO:teuthology.orchestra.run.smithi156.stderr:Ran 611 tests in 16439.187s 2019-11-27T22:02:48.073 INFO:teuthology.orchestra.run.smithi156.stderr: 2019-11-27T22:02:48.073 INFO:teuthology.orchestra.run.smithi156.stderr:OK (SKIP=75) 2019-11-27T22:02:48.134 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-27T22:02:48.134 INFO:teuthology.orchestra.run.smithi156:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-27T22:02:48.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-27T22:02:48.271 INFO:tasks.s3tests:Cleaning up boto... 2019-11-27T22:02:48.271 INFO:teuthology.orchestra.run.smithi156:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-27T22:02:48.315 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-27T22:02:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.551+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.673+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.673+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.694 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.693+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:48.695 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.693+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.704+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:48.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.704+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.712+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:48.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.952+0000 7fb10249fec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T22:02:48.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.952+0000 7fb10249fec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T22:02:48.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.952+0000 7fb10249fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T22:02:48.953 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.952+0000 7fb10249fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T22:02:48.954 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.952+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.966+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:48.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.966+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:48.981 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.980+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:48.982 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:48.980+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.003+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:49.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.003+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.026+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:49.027 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.026+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.041+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:49.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.041+0000 7fb10249fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T22:02:49.042 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.041+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.051+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:49.052 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.051+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.061 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.061+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:49.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.061+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.075 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.074+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:49.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.075+0000 7fb10249fec0 20 zonegroup default 2019-11-27T22:02:49.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.075+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.083+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:49.084 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.083+0000 7fb10249fec0 10 Cannot find current period zone using local zone 2019-11-27T22:02:49.085 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.083+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.090+0000 7fb10249fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:49.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.091+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.099+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:49.100 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.099+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:49.116 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.116+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.116+0000 7fb10249fec0 20 zone default found 2019-11-27T22:02:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.116+0000 7fb10249fec0 20 started sync module instance, tier type = 2019-11-27T22:02:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.116+0000 7fb10249fec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T22:02:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=0 2019-11-27T22:02:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=1 2019-11-27T22:02:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=2 2019-11-27T22:02:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=3 2019-11-27T22:02:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=4 2019-11-27T22:02:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.731+0000 7fb10249fec0 20 add_watcher() i=5 2019-11-27T22:02:49.767 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.766+0000 7fb10249fec0 20 add_watcher() i=6 2019-11-27T22:02:49.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.787+0000 7fb10249fec0 20 add_watcher() i=7 2019-11-27T22:02:49.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.787+0000 7fb10249fec0 2 all 8 watchers are set, enabling cache 2019-11-27T22:02:49.788 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.787+0000 7fb0bffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T22:02:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.791+0000 7fb0ef6cc700 0 -- 172.21.15.156:0/3988431625 >> v2:172.21.15.3:3300/0 conn(0x5639496a0270 msgr2=0x5639496a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T22:02:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:49.842+0000 7fb0ef6cc700 0 -- 172.21.15.156:0/3756649838 >> [v2:172.21.15.156:6802/10490,v1:172.21.15.156:6803/10490] conn(0x5639496b6580 msgr2=0x5639496b89a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-27T22:02:51.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.604+0000 7fb02e7fc700 20 reqs_thread_entry: start 2019-11-27T22:02:51.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.604+0000 7fb027fff700 20 reqs_thread_entry: start 2019-11-27T22:02:51.605 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.604+0000 7fb10249fec0 20 init_complete bucket index max shards: 0 2019-11-27T22:02:51.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.605+0000 7fb0267fc700 20 reqs_thread_entry: start 2019-11-27T22:02:51.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.605+0000 7fb10249fec0 20 get_system_obj_state: rctx=0x7ffe61865378 obj=default.rgw.meta:users.uid:bar.client.0 state=0x563949722ee0 s->prefetch_data=0 2019-11-27T22:02:51.606 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.605+0000 7fb10249fec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T22:02:51.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-27T22:02:51.625 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:02:51.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T22:02:51.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T22:02:51.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T22:02:51.626 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.624+0000 7fb10249fec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:51.645 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.645+0000 7fb10249fec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-27T22:02:51.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.645+0000 7fb10249fec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-27T22:02:51.646 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.645+0000 7fb10249fec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:02:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.662+0000 7fb10249fec0 10 removing key index: KKUKPNJXKHZNYJRCTKQO 2019-11-27T22:02:51.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.662+0000 7fb10249fec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=170 2019-11-27T22:02:51.681 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:51.680+0000 7fb0e4ff9700 10 RGWWatcher::handle_notify() notify_id 579820585485 cookie 94804044745840 notifier 4989 bl.length()=170 2019-11-27T22:02:52.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.343+0000 7fb10249fec0 10 removing email index: bar.client.0+test@test.test 2019-11-27T22:02:52.344 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.343+0000 7fb10249fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-27T22:02:52.354 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.354+0000 7fb0e4ff9700 10 RGWWatcher::handle_notify() notify_id 579820584999 cookie 94804044705424 notifier 4989 bl.length()=178 2019-11-27T22:02:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.633+0000 7fb10249fec0 10 removing user buckets index 2019-11-27T22:02:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.633+0000 7fb10249fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-27T22:02:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.652+0000 7fb0e4ff9700 10 RGWWatcher::handle_notify() notify_id 579820585166 cookie 94804044707296 notifier 4989 bl.length()=169 2019-11-27T22:02:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.761+0000 7fb10249fec0 10 removing user index: bar.client.0 2019-11-27T22:02:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.761+0000 7fb10249fec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-27T22:02:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.761+0000 7fb10249fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-27T22:02:52.777 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:52.777+0000 7fb0e4ff9700 10 RGWWatcher::handle_notify() notify_id 579820585000 cookie 94804044705424 notifier 4989 bl.length()=161 2019-11-27T22:02:53.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.102+0000 7fb10249fec0 20 remove_watcher() i=0 2019-11-27T22:02:53.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.102+0000 7fb10249fec0 2 removed watcher, disabling cache 2019-11-27T22:02:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.136+0000 7fb10249fec0 20 remove_watcher() i=1 2019-11-27T22:02:53.170 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.169+0000 7fb10249fec0 20 remove_watcher() i=2 2019-11-27T22:02:53.327 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.326+0000 7fb10249fec0 20 remove_watcher() i=3 2019-11-27T22:02:53.368 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.367+0000 7fb10249fec0 20 remove_watcher() i=4 2019-11-27T22:02:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.409+0000 7fb10249fec0 20 remove_watcher() i=5 2019-11-27T22:02:53.465 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.464+0000 7fb10249fec0 20 remove_watcher() i=6 2019-11-27T22:02:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.508+0000 7fb10249fec0 20 remove_watcher() i=7 2019-11-27T22:02:53.518 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-27T22:02:53.651 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.650+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:53.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.675+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:53.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.675+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:53.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.691+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:53.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.691+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:53.700 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.699+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:53.700 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.699+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:53.710+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.036+0000 7f4e11186ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T22:02:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.037+0000 7f4e11186ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T22:02:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.037+0000 7f4e11186ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T22:02:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.037+0000 7f4e11186ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T22:02:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.037+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.051 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.050+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:54.051 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.050+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.063 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.062+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:54.063 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.062+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.074+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:54.081 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.074+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.090+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:54.091 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.090+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.104+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:54.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.104+0000 7f4e11186ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T22:02:54.105 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.104+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.115 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.114+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:54.115 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.114+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.125+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.125+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.144+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.144+0000 7f4e11186ec0 20 zonegroup default 2019-11-27T22:02:54.146 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.144+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.155+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:54.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.155+0000 7f4e11186ec0 10 Cannot find current period zone using local zone 2019-11-27T22:02:54.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.155+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.162+0000 7f4e11186ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:54.163 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.162+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.172 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.171+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:54.172 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.171+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:54.188 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.187+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:54.188 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.187+0000 7f4e11186ec0 20 zone default found 2019-11-27T22:02:54.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.187+0000 7f4e11186ec0 20 started sync module instance, tier type = 2019-11-27T22:02:54.189 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.187+0000 7f4e11186ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T22:02:54.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=0 2019-11-27T22:02:54.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=1 2019-11-27T22:02:54.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=2 2019-11-27T22:02:54.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=3 2019-11-27T22:02:54.566 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=4 2019-11-27T22:02:54.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=5 2019-11-27T22:02:54.567 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.565+0000 7f4e11186ec0 20 add_watcher() i=6 2019-11-27T22:02:54.595 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.594+0000 7f4e11186ec0 20 add_watcher() i=7 2019-11-27T22:02:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.594+0000 7f4e11186ec0 2 all 8 watchers are set, enabling cache 2019-11-27T22:02:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.595+0000 7f4dcefdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T22:02:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.597+0000 7f4df5bb2700 0 -- 172.21.15.156:0/1728517530 >> v2:172.21.15.156:3300/0 conn(0x564fcf3c7dc0 msgr2=0x564fcf3ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-27T22:02:54.630 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:54.629+0000 7f4dfe3b3700 0 -- 172.21.15.156:0/3525698034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x564fcf3ca390 msgr2=0x564fcf3cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T22:02:55.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.967+0000 7f4d3d7fa700 20 reqs_thread_entry: start 2019-11-27T22:02:55.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.967+0000 7f4d36ffd700 20 reqs_thread_entry: start 2019-11-27T22:02:55.967 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.967+0000 7f4e11186ec0 20 init_complete bucket index max shards: 0 2019-11-27T22:02:55.968 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.968+0000 7f4d357fa700 20 reqs_thread_entry: start 2019-11-27T22:02:55.968 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.968+0000 7f4e11186ec0 20 get_system_obj_state: rctx=0x7ffc0ea16f98 obj=default.rgw.meta:users.uid:foo.client.0 state=0x564fcf442de0 s->prefetch_data=0 2019-11-27T22:02:55.968 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.968+0000 7f4e11186ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T22:02:55.988 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-27T22:02:55.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:02:55.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T22:02:55.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T22:02:55.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T22:02:55.989 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:55.988+0000 7f4e11186ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:56.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.015+0000 7f4e11186ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-27T22:02:56.015 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.015+0000 7f4e11186ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-27T22:02:56.015 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.015+0000 7f4e11186ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:02:56.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.049+0000 7f4e11186ec0 10 removing key index: YGYPQRNQWBDVWXOJILAH 2019-11-27T22:02:56.049 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.049+0000 7f4e11186ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=170 2019-11-27T22:02:56.062 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.063+0000 7f4ddf7fe700 10 RGWWatcher::handle_notify() notify_id 579820585001 cookie 94900779133728 notifier 5002 bl.length()=170 2019-11-27T22:02:56.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.387+0000 7f4e11186ec0 10 removing email index: foo.client.0+test@test.test 2019-11-27T22:02:56.387 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.387+0000 7f4e11186ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-27T22:02:56.402 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.403+0000 7f4ddf7fe700 10 RGWWatcher::handle_notify() notify_id 579820585486 cookie 94900779159936 notifier 5002 bl.length()=178 2019-11-27T22:02:56.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.620+0000 7f4e11186ec0 10 removing user buckets index 2019-11-27T22:02:56.620 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.620+0000 7f4e11186ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-27T22:02:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.633+0000 7f4ddf7fe700 10 RGWWatcher::handle_notify() notify_id 579820585002 cookie 94900779133728 notifier 5002 bl.length()=169 2019-11-27T22:02:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.820+0000 7f4e11186ec0 10 removing user index: foo.client.0 2019-11-27T22:02:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.820+0000 7f4e11186ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-27T22:02:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.820+0000 7f4e11186ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-27T22:02:56.833 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:56.833+0000 7f4ddf7fe700 10 RGWWatcher::handle_notify() notify_id 579820584993 cookie 94900779130384 notifier 5002 bl.length()=161 2019-11-27T22:02:57.258 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.259+0000 7f4e11186ec0 20 remove_watcher() i=0 2019-11-27T22:02:57.259 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.259+0000 7f4e11186ec0 2 removed watcher, disabling cache 2019-11-27T22:02:57.300 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.300+0000 7f4e11186ec0 20 remove_watcher() i=1 2019-11-27T22:02:57.331 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.332+0000 7f4e11186ec0 20 remove_watcher() i=2 2019-11-27T22:02:57.399 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.399+0000 7f4e11186ec0 20 remove_watcher() i=3 2019-11-27T22:02:57.443 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.444+0000 7f4e11186ec0 20 remove_watcher() i=4 2019-11-27T22:02:57.486 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.486+0000 7f4e11186ec0 20 remove_watcher() i=5 2019-11-27T22:02:57.533 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.533+0000 7f4e11186ec0 20 remove_watcher() i=6 2019-11-27T22:02:57.574 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.574+0000 7f4e11186ec0 20 remove_watcher() i=7 2019-11-27T22:02:57.585 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-27T22:02:57.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.719+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:57.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.744+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:57.744 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.744+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.848+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.848+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:57.885 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.885+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:57.886 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.885+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:57.906 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:57.906+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:58.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.251+0000 7fe42b2e5ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T22:02:58.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.251+0000 7fe42b2e5ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T22:02:58.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.251+0000 7fe42b2e5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T22:02:58.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.251+0000 7fe42b2e5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T22:02:58.252 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.251+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.262 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.262+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:58.262 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.262+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.274+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:58.274 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.274+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.285+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:58.285 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.285+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.301+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:58.301 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.301+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.319+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.319+0000 7fe42b2e5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T22:02:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.319+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.334 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.335+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:58.335 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.335+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.348+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:58.348 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.348+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.396+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:02:58.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.396+0000 7fe42b2e5ec0 20 zonegroup default 2019-11-27T22:02:58.397 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.396+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.408+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:58.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.408+0000 7fe42b2e5ec0 10 Cannot find current period zone using local zone 2019-11-27T22:02:58.409 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.408+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.425 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.424+0000 7fe42b2e5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:02:58.426 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.424+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.436 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.435+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:02:58.436 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.435+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:02:58.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.454+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:02:58.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.455+0000 7fe42b2e5ec0 20 zone default found 2019-11-27T22:02:58.456 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.455+0000 7fe42b2e5ec0 20 started sync module instance, tier type = 2019-11-27T22:02:58.457 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.455+0000 7fe42b2e5ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=0 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=1 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=2 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=3 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=4 2019-11-27T22:02:58.804 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.803+0000 7fe42b2e5ec0 20 add_watcher() i=5 2019-11-27T22:02:58.831 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.830+0000 7fe42b2e5ec0 20 add_watcher() i=6 2019-11-27T22:02:58.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.841+0000 7fe42b2e5ec0 20 add_watcher() i=7 2019-11-27T22:02:58.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.841+0000 7fe42b2e5ec0 2 all 8 watchers are set, enabling cache 2019-11-27T22:02:58.842 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.841+0000 7fe3e8fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T22:02:58.848 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:58.848+0000 7fe418512700 0 -- 172.21.15.156:0/4174769493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5638b34ac010 msgr2=0x5638b34b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T22:02:59.051 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:59.050+0000 7fe418512700 0 --2- 172.21.15.156:0/4174769493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5638b34ac010 0x5638b34b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-27T22:02:59.112 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:02:59.111+0000 7fe40fd11700 0 -- 172.21.15.156:0/3193616095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638b34ba580 msgr2=0x5638b34bc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T22:03:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.653+0000 7fe35affd700 20 reqs_thread_entry: start 2019-11-27T22:03:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.653+0000 7fe358ff9700 20 reqs_thread_entry: start 2019-11-27T22:03:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.653+0000 7fe42b2e5ec0 20 init_complete bucket index max shards: 0 2019-11-27T22:03:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.653+0000 7fe34effd700 20 reqs_thread_entry: start 2019-11-27T22:03:00.656 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.653+0000 7fe42b2e5ec0 20 get_system_obj_state: rctx=0x7ffe3fdedfb8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x5638b352a200 s->prefetch_data=0 2019-11-27T22:03:00.656 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.654+0000 7fe42b2e5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-27T22:03:00.668 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-27T22:03:00.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T22:03:00.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-27T22:03:00.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-27T22:03:00.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-27T22:03:00.669 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.663+0000 7fe42b2e5ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:00.676 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.675+0000 7fe42b2e5ec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-27T22:03:00.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.675+0000 7fe42b2e5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-27T22:03:00.677 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.675+0000 7fe42b2e5ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-27T22:03:00.691 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.691+0000 7fe42b2e5ec0 10 removing key index: VJLTUPCYUONTGFESFQEH 2019-11-27T22:03:00.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.691+0000 7fe42b2e5ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=170 2019-11-27T22:03:00.699 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.698+0000 7fe40dd0d700 10 RGWWatcher::handle_notify() notify_id 579820585167 cookie 94801526084416 notifier 4676 bl.length()=170 2019-11-27T22:03:00.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.802+0000 7fe42b2e5ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-27T22:03:00.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.802+0000 7fe42b2e5ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-27T22:03:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:00.814+0000 7fe40dd0d700 10 RGWWatcher::handle_notify() notify_id 579820585487 cookie 94801526126832 notifier 4676 bl.length()=193 2019-11-27T22:03:01.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.493+0000 7fe42b2e5ec0 10 removing user buckets index 2019-11-27T22:03:01.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.493+0000 7fe42b2e5ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-27T22:03:01.513 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.512+0000 7fe40dd0d700 10 RGWWatcher::handle_notify() notify_id 579820585488 cookie 94801526125680 notifier 4676 bl.length()=184 2019-11-27T22:03:01.928 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.927+0000 7fe42b2e5ec0 10 removing user index: testx$tenanteduser.client.0 2019-11-27T22:03:01.928 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.927+0000 7fe42b2e5ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-27T22:03:01.928 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.927+0000 7fe42b2e5ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-27T22:03:01.940 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:01.939+0000 7fe40dd0d700 10 RGWWatcher::handle_notify() notify_id 579820585168 cookie 94801526109184 notifier 4676 bl.length()=176 2019-11-27T22:03:02.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.398+0000 7fe42b2e5ec0 20 remove_watcher() i=0 2019-11-27T22:03:02.400 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.398+0000 7fe42b2e5ec0 2 removed watcher, disabling cache 2019-11-27T22:03:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.441+0000 7fe42b2e5ec0 20 remove_watcher() i=1 2019-11-27T22:03:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.477+0000 7fe42b2e5ec0 20 remove_watcher() i=2 2019-11-27T22:03:02.545 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.544+0000 7fe42b2e5ec0 20 remove_watcher() i=3 2019-11-27T22:03:02.632 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.632+0000 7fe42b2e5ec0 20 remove_watcher() i=4 2019-11-27T22:03:02.671 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.670+0000 7fe42b2e5ec0 20 remove_watcher() i=5 2019-11-27T22:03:02.718 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.717+0000 7fe42b2e5ec0 20 remove_watcher() i=6 2019-11-27T22:03:02.760 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:02.759+0000 7fe42b2e5ec0 20 remove_watcher() i=7 2019-11-27T22:03:02.770 INFO:tasks.s3tests:Removing s3-tests... 2019-11-27T22:03:02.770 INFO:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-27T22:03:02.912 INFO:teuthology.run_tasks:Running task swift... 2019-11-27T22:03:02.925 INFO:tasks.swift:clients=['client.0'] 2019-11-27T22:03:02.925 INFO:tasks.swift:Downloading swift... 2019-11-27T22:03:02.925 INFO:teuthology.orchestra.run.smithi156:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-27T22:03:03.071 INFO:teuthology.orchestra.run.smithi156.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-27T22:03:03.499 INFO:tasks.swift:Creating rgw users... 2019-11-27T22:03:03.500 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret f9S9it96H+QnGdfaXVOrlCOp7NRygvML/ewRrUUfZ85VnviM79cOsg== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-27T22:03:03.663 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.662+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:03.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.691+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:03.692 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.691+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:03.704 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.704+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:03.705 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.704+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:03.712 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.711+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:03.712 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.711+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:03.720 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.719+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:04.000 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.999+0000 7f2656f6dec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T22:03:04.000 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.999+0000 7f2656f6dec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T22:03:04.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.999+0000 7f2656f6dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T22:03:04.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.999+0000 7f2656f6dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T22:03:04.001 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:03.999+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.013+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:04.014 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.013+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.039+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:03:04.040 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.039+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.047 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.047+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:04.048 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.047+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.066 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.065+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:03:04.067 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.065+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.078 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.077+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:04.079 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.077+0000 7f2656f6dec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T22:03:04.079 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.077+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.086 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.085+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:04.086 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.085+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.093+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:04.094 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.093+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.109 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.108+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:03:04.109 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.108+0000 7f2656f6dec0 20 zonegroup default 2019-11-27T22:03:04.110 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.108+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.118 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.118+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:04.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.118+0000 7f2656f6dec0 10 Cannot find current period zone using local zone 2019-11-27T22:03:04.119 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.118+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.125 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.125+0000 7f2656f6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:04.126 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.125+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.133 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.132+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:04.133 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.132+0000 7f2656f6dec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.146+0000 7f2656f6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:03:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.146+0000 7f2656f6dec0 20 zone default found 2019-11-27T22:03:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.146+0000 7f2656f6dec0 20 started sync module instance, tier type = 2019-11-27T22:03:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.146+0000 7f2656f6dec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T22:03:04.587 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=0 2019-11-27T22:03:04.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=1 2019-11-27T22:03:04.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=2 2019-11-27T22:03:04.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=3 2019-11-27T22:03:04.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=4 2019-11-27T22:03:04.588 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=5 2019-11-27T22:03:04.589 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.586+0000 7f2656f6dec0 20 add_watcher() i=6 2019-11-27T22:03:04.618 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.617+0000 7f2656f6dec0 20 add_watcher() i=7 2019-11-27T22:03:04.618 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.617+0000 7f2656f6dec0 2 all 8 watchers are set, enabling cache 2019-11-27T22:03:04.619 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.617+0000 7f2614fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T22:03:04.635 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.635+0000 7f264419a700 0 -- 172.21.15.156:0/1739251605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c7de5a0f0 msgr2=0x563c7de609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T22:03:04.662 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:04.661+0000 7f264499b700 0 -- 172.21.15.156:0/1853370776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c7de5df30 msgr2=0x563c7de5e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T22:03:06.074 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.072+0000 7f2586ffd700 20 reqs_thread_entry: start 2019-11-27T22:03:06.076 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.072+0000 7f2584ff9700 20 reqs_thread_entry: start 2019-11-27T22:03:06.077 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.072+0000 7f2656f6dec0 20 init_complete bucket index max shards: 0 2019-11-27T22:03:06.077 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.073+0000 7f257affd700 20 reqs_thread_entry: start 2019-11-27T22:03:06.077 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.073+0000 7f2656f6dec0 20 get_system_obj_state: rctx=0x7ffd9aaed038 obj=default.rgw.meta:users.uid:foo.client.0 state=0x563c7ded8d80 s->prefetch_data=0 2019-11-27T22:03:06.077 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.073+0000 7f2656f6dec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-27T22:03:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.081+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-27T22:03:06.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.081+0000 7f2656f6dec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:03:06.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.081+0000 7f2656f6dec0 20 get_system_obj_state: rctx=0x7ffd9aaed048 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x563c7dedab10 s->prefetch_data=0 2019-11-27T22:03:06.083 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.081+0000 7f2656f6dec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-27T22:03:06.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.087+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-27T22:03:06.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.087+0000 7f2656f6dec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T22:03:06.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.087+0000 7f2656f6dec0 20 get_system_obj_state: rctx=0x7ffd9aaecc58 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x563c7dedab10 s->prefetch_data=0 2019-11-27T22:03:06.089 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.087+0000 7f2656f6dec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-27T22:03:06.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.095+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-27T22:03:06.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.095+0000 7f2656f6dec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T22:03:06.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.095+0000 7f2656f6dec0 20 get_system_obj_state: rctx=0x7ffd9aaecdd8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x563c7dedadc0 s->prefetch_data=0 2019-11-27T22:03:06.096 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.095+0000 7f2656f6dec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-27T22:03:06.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.102+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-27T22:03:06.103 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.102+0000 7f2656f6dec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T22:03:06.150 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.149+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T22:03:06.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.149+0000 7f2656f6dec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:03:06.152 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.149+0000 7f2656f6dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-27T22:03:06.161 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.160+0000 7f2629ffb700 10 RGWWatcher::handle_notify() notify_id 579820584994 cookie 94817810133232 notifier 4682 bl.length()=612 2019-11-27T22:03:06.161 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.160+0000 7f2629ffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T22:03:06.162 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.160+0000 7f2629ffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:03:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.466+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T22:03:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.466+0000 7f2656f6dec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T22:03:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.466+0000 7f2656f6dec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-27T22:03:06.493 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.492+0000 7f2629ffb700 10 RGWWatcher::handle_notify() notify_id 579820585489 cookie 94817810161168 notifier 4682 bl.length()=194 2019-11-27T22:03:06.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.492+0000 7f2629ffb700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-27T22:03:06.494 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.493+0000 7f2629ffb700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-27T22:03:06.741 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.740+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-27T22:03:06.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.740+0000 7f2656f6dec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T22:03:06.742 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.740+0000 7f2656f6dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-27T22:03:06.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.751+0000 7f2629ffb700 10 RGWWatcher::handle_notify() notify_id 579820585003 cookie 94817810136672 notifier 4682 bl.length()=183 2019-11-27T22:03:06.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.751+0000 7f2629ffb700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-27T22:03:06.753 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.751+0000 7f2629ffb700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-27T22:03:06.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.869+0000 7f2656f6dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T22:03:06.870 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.869+0000 7f2656f6dec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:03:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.869+0000 7f2656f6dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-27T22:03:06.886 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.885+0000 7f2629ffb700 10 RGWWatcher::handle_notify() notify_id 579820584995 cookie 94817810133232 notifier 4682 bl.length()=636 2019-11-27T22:03:06.886 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.885+0000 7f2629ffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-27T22:03:06.886 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:06.885+0000 7f2629ffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-27T22:03:07.153 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T22:03:07.154 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "foo.client.0", 2019-11-27T22:03:07.154 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-27T22:03:07.154 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "foo.client.0+test@test.test", 2019-11-27T22:03:07.155 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T22:03:07.155 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T22:03:07.155 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [ 2019-11-27T22:03:07.156 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T22:03:07.156 INFO:teuthology.orchestra.run.smithi156.stdout: "id": "foo.client.0:foo", 2019-11-27T22:03:07.157 INFO:teuthology.orchestra.run.smithi156.stdout: "permissions": "full-control" 2019-11-27T22:03:07.157 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T22:03:07.157 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T22:03:07.158 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [], 2019-11-27T22:03:07.158 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [ 2019-11-27T22:03:07.158 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T22:03:07.159 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "foo.client.0:foo", 2019-11-27T22:03:07.159 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "f9S9it96H+QnGdfaXVOrlCOp7NRygvML/ewRrUUfZ85VnviM79cOsg==" 2019-11-27T22:03:07.159 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T22:03:07.160 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T22:03:07.161 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T22:03:07.161 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T22:03:07.161 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T22:03:07.162 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T22:03:07.162 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T22:03:07.162 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T22:03:07.163 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T22:03:07.163 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T22:03:07.163 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T22:03:07.163 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T22:03:07.164 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T22:03:07.164 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T22:03:07.164 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T22:03:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T22:03:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T22:03:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T22:03:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T22:03:07.166 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T22:03:07.166 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T22:03:07.166 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T22:03:07.167 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T22:03:07.167 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T22:03:07.167 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T22:03:07.167 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T22:03:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.216+0000 7f2656f6dec0 20 remove_watcher() i=0 2019-11-27T22:03:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.216+0000 7f2656f6dec0 2 removed watcher, disabling cache 2019-11-27T22:03:07.279 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.278+0000 7f2656f6dec0 20 remove_watcher() i=1 2019-11-27T22:03:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.362+0000 7f2656f6dec0 20 remove_watcher() i=2 2019-11-27T22:03:07.423 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.422+0000 7f2656f6dec0 20 remove_watcher() i=3 2019-11-27T22:03:07.483 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.482+0000 7f2656f6dec0 20 remove_watcher() i=4 2019-11-27T22:03:07.540 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.539+0000 7f2656f6dec0 20 remove_watcher() i=5 2019-11-27T22:03:07.586 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.586+0000 7f2656f6dec0 20 remove_watcher() i=6 2019-11-27T22:03:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.638+0000 7f2656f6dec0 20 remove_watcher() i=7 2019-11-27T22:03:07.645 INFO:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret I/hlLkbdm31y6bbkQ3bnxBDnBxbB9lQzQw+SJI5cJBciQk5oovGlRw== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-27T22:03:07.770 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.769+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:07.790 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.790+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:07.791 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.790+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:07.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.802+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:07.803 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.802+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:07.809 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.809+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:07.810 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.809+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:07.817 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:07.816+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:08.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.165+0000 7f276e476ec0 20 RGWRados::pool_iterate: got zone_info.52e9f6d5-9017-4df2-9490-35fe7d8cf870 2019-11-27T22:03:08.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.165+0000 7f276e476ec0 20 RGWRados::pool_iterate: got zonegroup_info.ccc87b11-5d1c-47f4-9e21-005212e93497 2019-11-27T22:03:08.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.165+0000 7f276e476ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-27T22:03:08.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.165+0000 7f276e476ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-27T22:03:08.166 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.165+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.175 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.174+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:08.176 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.174+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.189+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:03:08.190 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.189+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.200 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.200+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:08.201 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.200+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.209+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:03:08.210 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.209+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.223 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.222+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:08.224 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.223+0000 7f276e476ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-27T22:03:08.224 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.223+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.233+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:08.234 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.233+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.242+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:08.243 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.242+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.255+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-27T22:03:08.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.255+0000 7f276e476ec0 20 zonegroup default 2019-11-27T22:03:08.256 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.255+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.264 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.264+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:08.265 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.264+0000 7f276e476ec0 10 Cannot find current period zone using local zone 2019-11-27T22:03:08.265 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.264+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.272 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.272+0000 7f276e476ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-27T22:03:08.273 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.272+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.282+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-27T22:03:08.283 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.282+0000 7f276e476ec0 20 rados->read ofs=0 len=0 2019-11-27T22:03:08.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.290+0000 7f276e476ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-27T22:03:08.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.290+0000 7f276e476ec0 20 zone default found 2019-11-27T22:03:08.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.290+0000 7f276e476ec0 20 started sync module instance, tier type = 2019-11-27T22:03:08.291 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.290+0000 7f276e476ec0 20 started zone id=52e9f6d5-9017-4df2-9490-35fe7d8cf870 (name=default) with tier type = 2019-11-27T22:03:08.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=0 2019-11-27T22:03:08.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=1 2019-11-27T22:03:08.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=2 2019-11-27T22:03:08.689 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=3 2019-11-27T22:03:08.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=4 2019-11-27T22:03:08.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=5 2019-11-27T22:03:08.690 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.688+0000 7f276e476ec0 20 add_watcher() i=6 2019-11-27T22:03:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.736+0000 7f276e476ec0 20 add_watcher() i=7 2019-11-27T22:03:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.736+0000 7f276e476ec0 2 all 8 watchers are set, enabling cache 2019-11-27T22:03:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.736+0000 7f272bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-27T22:03:08.739 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.738+0000 7f275aea2700 0 -- 172.21.15.156:0/2471449499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x555d333f3df0 msgr2=0x555d333f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-27T22:03:08.774 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:08.773+0000 7f275bea4700 0 -- 172.21.15.156:0/3059294970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x555d333f40a0 msgr2=0x555d333f44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-27T22:03:10.141 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.140+0000 7f269a7fc700 20 reqs_thread_entry: start 2019-11-27T22:03:10.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.140+0000 7f2693fff700 20 reqs_thread_entry: start 2019-11-27T22:03:10.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.140+0000 7f276e476ec0 20 init_complete bucket index max shards: 0 2019-11-27T22:03:10.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.141+0000 7f26927fc700 20 reqs_thread_entry: start 2019-11-27T22:03:10.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.141+0000 7f276e476ec0 20 get_system_obj_state: rctx=0x7ffe841950d8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x555d33470170 s->prefetch_data=0 2019-11-27T22:03:10.142 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.141+0000 7f276e476ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-27T22:03:10.150 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.150+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-27T22:03:10.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.150+0000 7f276e476ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:03:10.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.150+0000 7f276e476ec0 20 get_system_obj_state: rctx=0x7ffe841950e8 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x555d33471f00 s->prefetch_data=0 2019-11-27T22:03:10.151 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.150+0000 7f276e476ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-27T22:03:10.155 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.155+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-27T22:03:10.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.155+0000 7f276e476ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T22:03:10.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.155+0000 7f276e476ec0 20 get_system_obj_state: rctx=0x7ffe84194cf8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x555d33471f00 s->prefetch_data=0 2019-11-27T22:03:10.156 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.155+0000 7f276e476ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-27T22:03:10.164 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.164+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-27T22:03:10.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.164+0000 7f276e476ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T22:03:10.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.164+0000 7f276e476ec0 20 get_system_obj_state: rctx=0x7ffe84194e78 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x555d334721b0 s->prefetch_data=0 2019-11-27T22:03:10.165 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.164+0000 7f276e476ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-27T22:03:10.174 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.173+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-27T22:03:10.174 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.173+0000 7f276e476ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T22:03:10.221 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.220+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T22:03:10.221 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.220+0000 7f276e476ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:03:10.222 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.220+0000 7f276e476ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-27T22:03:10.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.228+0000 7f2740ff9700 10 RGWWatcher::handle_notify() notify_id 579820585004 cookie 93858779986160 notifier 5050 bl.length()=612 2019-11-27T22:03:10.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.228+0000 7f2740ff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T22:03:10.229 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.228+0000 7f2740ff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:03:10.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.307+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T22:03:10.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.307+0000 7f276e476ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T22:03:10.308 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.307+0000 7f276e476ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-27T22:03:10.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.315+0000 7f2740ff9700 10 RGWWatcher::handle_notify() notify_id 579820585005 cookie 93858779986160 notifier 5050 bl.length()=194 2019-11-27T22:03:10.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.315+0000 7f2740ff9700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-27T22:03:10.316 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.315+0000 7f2740ff9700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-27T22:03:10.392 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.391+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-27T22:03:10.392 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.391+0000 7f276e476ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T22:03:10.392 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.391+0000 7f276e476ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-27T22:03:10.399 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.398+0000 7f2740ff9700 10 RGWWatcher::handle_notify() notify_id 579820585169 cookie 93858780009936 notifier 5050 bl.length()=183 2019-11-27T22:03:10.672 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.398+0000 7f2740ff9700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-27T22:03:10.672 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.398+0000 7f2740ff9700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-27T22:03:10.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.800+0000 7f276e476ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T22:03:10.801 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.800+0000 7f276e476ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:03:10.802 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.800+0000 7f276e476ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-27T22:03:10.812 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.809+0000 7f2740ff9700 10 RGWWatcher::handle_notify() notify_id 579820585006 cookie 93858779986160 notifier 5050 bl.length()=636 2019-11-27T22:03:10.813 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.809+0000 7f2740ff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-27T22:03:10.813 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:10.809+0000 7f2740ff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-27T22:03:10.928 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2019-11-27T22:03:10.928 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "bar.client.0", 2019-11-27T22:03:10.928 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-27T22:03:10.928 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "bar.client.0+test@test.test", 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [ 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: "id": "bar.client.0:bar", 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: "permissions": "full-control" 2019-11-27T22:03:10.929 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [], 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [ 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: { 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "bar.client.0:bar", 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "I/hlLkbdm31y6bbkQ3bnxBDnBxbB9lQzQw+SJI5cJBciQk5oovGlRw==" 2019-11-27T22:03:10.930 INFO:teuthology.orchestra.run.smithi156.stdout: } 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2019-11-27T22:03:10.931 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2019-11-27T22:03:10.932 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2019-11-27T22:03:10.933 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2019-11-27T22:03:10.934 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2019-11-27T22:03:10.934 INFO:teuthology.orchestra.run.smithi156.stdout:} 2019-11-27T22:03:10.934 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T22:03:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.003+0000 7f276e476ec0 20 remove_watcher() i=0 2019-11-27T22:03:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.003+0000 7f276e476ec0 2 removed watcher, disabling cache 2019-11-27T22:03:11.046 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.046+0000 7f276e476ec0 20 remove_watcher() i=1 2019-11-27T22:03:11.088 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.087+0000 7f276e476ec0 20 remove_watcher() i=2 2019-11-27T22:03:11.204 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.203+0000 7f276e476ec0 20 remove_watcher() i=3 2019-11-27T22:03:11.251 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.250+0000 7f276e476ec0 20 remove_watcher() i=4 2019-11-27T22:03:11.297 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.296+0000 7f276e476ec0 20 remove_watcher() i=5 2019-11-27T22:03:11.351 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.350+0000 7f276e476ec0 20 remove_watcher() i=6 2019-11-27T22:03:11.410 INFO:teuthology.orchestra.run.smithi156.stderr:2019-11-27T22:03:11.410+0000 7f276e476ec0 20 remove_watcher() i=7 2019-11-27T22:03:11.419 INFO:tasks.swift:Configuring testswift... 2019-11-27T22:03:11.419 INFO:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-27T22:03:14.021 INFO:teuthology.orchestra.run.smithi156.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-27T22:03:15.288 INFO:teuthology.orchestra.run.smithi156.stdout:Installing setuptools, pip, wheel...done. 2019-11-27T22:03:15.541 INFO:teuthology.orchestra.run.smithi156.stderr:Cache entry deserialization failed, entry ignored 2019-11-27T22:03:15.656 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pip 2019-11-27T22:03:15.735 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-27T22:03:15.798 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: pip 2019-11-27T22:03:15.799 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: pip 9.0.1 2019-11-27T22:03:15.857 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling pip-9.0.1: 2019-11-27T22:03:15.907 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled pip-9.0.1 2019-11-27T22:03:16.485 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed pip-19.3.1 2019-11-27T22:03:16.824 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T22:03:17.315 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting setuptools==32.3.1 2019-11-27T22:03:17.318 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-27T22:03:17.362 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: setuptools 2019-11-27T22:03:17.363 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: setuptools 28.8.0 2019-11-27T22:03:17.387 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling setuptools-28.8.0: 2019-11-27T22:03:17.398 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-27T22:03:17.526 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed setuptools-32.3.1 2019-11-27T22:03:17.987 INFO:teuthology.orchestra.run.smithi156.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-27T22:03:18.162 INFO:teuthology.orchestra.run.smithi156.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-27T22:03:18.231 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting nose>=1.0.0 2019-11-27T22:03:18.234 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-27T22:03:18.377 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto>=2.0b4 2019-11-27T22:03:18.385 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-27T22:03:18.536 INFO:teuthology.orchestra.run.smithi156.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-27T22:03:18.838 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting gevent>=0.14 2019-11-27T22:03:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T22:03:19.098 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting isodate>=0.4.4 2019-11-27T22:03:19.100 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-27T22:03:19.178 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting eventlet>=0.9.14 2019-11-27T22:03:19.240 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-27T22:03:19.400 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting netifaces>=0.5 2019-11-27T22:03:19.409 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T22:03:19.525 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-27T22:03:19.536 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-27T22:03:19.989 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting simplejson>=2.1.3 2019-11-27T22:03:19.999 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-27T22:03:20.396 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting WebOb==1.0 2019-11-27T22:03:20.408 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-27T22:03:20.850 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-27T22:03:20.852 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-27T22:03:20.921 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting six 2019-11-27T22:03:20.923 INFO:teuthology.orchestra.run.smithi156.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-27T22:03:20.985 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting monotonic>=1.4 2019-11-27T22:03:20.996 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-27T22:03:21.083 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting dnspython>=1.15.0 2019-11-27T22:03:21.094 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-27T22:03:21.217 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting enum34; python_version < "3.4" 2019-11-27T22:03:21.227 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-27T22:03:21.260 INFO:teuthology.orchestra.run.smithi156.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-27T22:03:21.260 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for xattr (setup.py): started 2019-11-27T22:03:21.781 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-27T22:03:21.782 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24117 sha256=20a3c1c63fc092c7bf5779e2c15f2a0ab295f01346b6c67136202612e02925e1 2019-11-27T22:03:21.782 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-27T22:03:21.791 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for simplejson (setup.py): started 2019-11-27T22:03:22.959 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-27T22:03:22.959 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113121 sha256=5316d05563649602a015a70d0c14f9f0c738da08d895b25ac256eaf0042afdd6 2019-11-27T22:03:22.960 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-27T22:03:22.972 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for WebOb (setup.py): started 2019-11-27T22:03:23.260 INFO:teuthology.orchestra.run.smithi156.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-27T22:03:23.261 INFO:teuthology.orchestra.run.smithi156.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=d058d84350dcfcfa6d14889605f59f06feba79c87fb744dadc49e956ac9c7bab 2019-11-27T22:03:23.261 INFO:teuthology.orchestra.run.smithi156.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-27T22:03:23.268 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully built xattr simplejson WebOb 2019-11-27T22:03:23.313 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-27T22:03:24.833 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-27T22:03:25.113 INFO:teuthology.orchestra.run.smithi156.stdout:running develop 2019-11-27T22:03:25.158 INFO:teuthology.orchestra.run.smithi156.stdout:running egg_info 2019-11-27T22:03:25.159 INFO:teuthology.orchestra.run.smithi156.stdout:creating swift.egg-info 2019-11-27T22:03:25.159 INFO:teuthology.orchestra.run.smithi156.stdout:writing swift.egg-info/PKG-INFO 2019-11-27T22:03:25.159 INFO:teuthology.orchestra.run.smithi156.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-27T22:03:25.159 INFO:teuthology.orchestra.run.smithi156.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-27T22:03:25.163 INFO:teuthology.orchestra.run.smithi156.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-27T22:03:25.163 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T22:03:25.167 INFO:teuthology.orchestra.run.smithi156.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T22:03:25.167 INFO:teuthology.orchestra.run.smithi156.stdout:reading manifest template 'MANIFEST.in' 2019-11-27T22:03:25.167 INFO:teuthology.orchestra.run.smithi156.stderr:warning: no files found matching 'ChangeLog' 2019-11-27T22:03:25.170 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-27T22:03:25.172 INFO:teuthology.orchestra.run.smithi156.stdout:running build_ext 2019-11-27T22:03:25.172 INFO:teuthology.orchestra.run.smithi156.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-27T22:03:25.172 INFO:teuthology.orchestra.run.smithi156.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-27T22:03:25.188 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.189 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.191 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.192 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.193 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.193 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.194 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.195 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.196 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.197 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.197 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.199 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.200 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.201 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.202 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.202 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.204 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.205 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.206 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.207 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.207 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.211 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.213 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.218 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.220 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.222 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.223 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.226 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.227 INFO:teuthology.orchestra.run.smithi156.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-27T22:03:25.227 INFO:teuthology.orchestra.run.smithi156.stdout: 2019-11-27T22:03:25.227 INFO:teuthology.orchestra.run.smithi156.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-27T22:03:25.228 INFO:teuthology.orchestra.run.smithi156.stdout:Processing dependencies for swift==1.4.4 2019-11-27T22:03:25.228 INFO:teuthology.orchestra.run.smithi156.stdout:Finished processing dependencies for swift==1.4.4 2019-11-27T22:03:25.239 INFO:teuthology.orchestra.run.smithi156:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-27T22:03:25.288 INFO:teuthology.orchestra.run.smithi156:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-27T22:03:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-27T22:04:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-27T22:06:43.022 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:06:50.497 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.032 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:06:50.507 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.046 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:06:50.523 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.050 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:06:50.527 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.051 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:06:50.528 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.055 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:06:50.532 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.238 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:06:50.714 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.283 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:06:50.760 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:06:43.303 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:06:50.778 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.237 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:07:41.711 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.239 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:07:41.714 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.277 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:07:41.753 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.281 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:07:41.758 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.311 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:07:41.788 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.316 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:07:41.793 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.321 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:07:41.796 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.322 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:07:41.799 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:07:34.387 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:07:41.864 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:07.197 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-27T22:09:21.521 INFO:teuthology.orchestra.run.smithi156.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-27T22:09:24.679 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:09:32.154 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.680 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:09:32.155 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.744 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:09:32.221 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.762 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:09:32.237 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.771 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:09:32.248 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.772 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:09:32.249 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.782 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:09:32.259 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.865 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:09:32.343 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:24.901 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:09:32.378 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:09:25.692 INFO:teuthology.orchestra.run.smithi156.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-27T22:09:41.766 INFO:teuthology.orchestra.run.smithi156.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-27T22:10:02.912 INFO:teuthology.orchestra.run.smithi156.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-27T22:10:57.085 INFO:teuthology.orchestra.run.smithi156.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-27T22:10:57.620 INFO:teuthology.orchestra.run.smithi156.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-27T22:11:54.170 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:12:01.645 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.176 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:12:01.651 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.181 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:12:01.658 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.188 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:12:01.665 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.189 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:12:01.667 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.192 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:12:01.669 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.288 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:12:01.765 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.307 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:12:01.784 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:11:54.327 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:12:01.803 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.401 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:16:03.877 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.438 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:16:03.915 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.461 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:16:03.936 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.465 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:16:03.942 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.504 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:16:03.980 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.505 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:16:03.981 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.606 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:16:04.080 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.625 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:16:04.102 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:15:56.628 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:16:04.105 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.442 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:17:12.917 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.448 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:17:12.923 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.465 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:17:12.940 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.468 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:17:12.946 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.527 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:17:13.004 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.533 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:17:13.010 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.550 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:17:13.028 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.581 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:17:13.057 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:05.598 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:17:13.073 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:17:55.006 INFO:teuthology.orchestra.run.smithi156.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-27T22:17:59.400 INFO:teuthology.orchestra.run.smithi156.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-27T22:18:32.486 INFO:teuthology.orchestra.run.smithi156.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:18:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:22:17.840 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:22:25.315 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:17.857 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:22:25.333 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:17.857 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:22:25.326 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:17.857 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:22:25.334 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:17.859 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:22:25.336 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:17.863 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:22:25.341 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:18.033 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:22:25.510 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:18.069 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:22:25.545 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:22:18.109 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:22:25.586 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:23:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:23:41.606 INFO:teuthology.orchestra.run.smithi156.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:23:46.029 INFO:teuthology.orchestra.run.smithi156.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:23:57.983 INFO:teuthology.orchestra.run.smithi156.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:24:15.150 INFO:teuthology.orchestra.run.smithi156.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:24:18.258 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:24:25.733 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.264 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:24:25.739 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.286 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:24:25.757 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.309 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:24:25.786 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.322 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:24:25.799 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.345 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:24:25.822 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.390 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:24:25.867 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.405 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:24:25.878 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:24:18.511 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:24:25.987 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:25:46.909 INFO:teuthology.orchestra.run.smithi156.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:25:47.258 INFO:teuthology.orchestra.run.smithi156.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-27T22:27:30.115 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:27:37.591 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.128 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:27:37.603 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.144 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:27:37.622 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.146 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:27:37.624 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.150 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:27:37.628 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.162 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:27:37.640 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.304 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:27:37.781 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.304 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:27:37.781 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:27:30.403 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:27:37.878 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.115 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:47.591 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.137 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:47.613 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.164 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:47.641 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.166 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:47.644 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.172 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:47.650 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.179 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:47.657 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.275 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:47.751 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.305 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:47.783 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:40.358 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:47.835 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.855 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:49.332 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.861 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:49.338 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.869 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:49.347 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.872 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:49.350 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.880 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:32:49.358 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.893 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:32:49.371 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.901 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:49.377 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.906 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:49.382 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:41.931 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:32:49.407 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:32:59.751 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:03.047 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:05.282 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:08.166 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:08.747 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:09.544 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:19.265 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:25.048 INFO:teuthology.orchestra.run.smithi156.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:33.861 INFO:teuthology.orchestra.run.smithi156.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-27T22:33:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-27T22:35:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-27T22:35:31.949 INFO:teuthology.orchestra.run.smithi156.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-27T22:35:47.139 INFO:teuthology.orchestra.run.smithi156.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-27T22:35:55.239 INFO:teuthology.orchestra.run.smithi156.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-27T22:36:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-27T22:37:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-11-27T22:37:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-11-27T22:37:54.065 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:38:01.541 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.075 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:38:01.551 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.080 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:38:01.558 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.082 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:38:01.560 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.085 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:38:01.563 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.087 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:38:01.565 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.343 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:38:01.820 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.350 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:38:01.827 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:37:54.384 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:38:01.860 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:39:13.280 INFO:teuthology.orchestra.run.smithi156.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-11-27T22:41:07.088 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:41:14.564 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.102 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:41:14.578 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.127 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:41:14.605 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.131 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:41:14.609 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.133 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:41:14.611 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.143 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:41:14.620 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.230 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:41:14.707 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.253 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:41:14.729 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:41:07.262 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:41:14.740 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.949 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:43:12.425 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.961 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:43:12.437 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.963 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:43:12.441 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.970 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:43:12.447 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.970 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:43:12.447 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:04.980 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:43:12.458 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:05.054 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:43:12.532 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:05.066 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:43:12.542 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:05.073 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:43:12.551 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:43:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T22:44:05.416 INFO:teuthology.orchestra.run.smithi156.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T22:44:24.420 INFO:teuthology.orchestra.run.smithi156.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-11-27T22:46:12.318 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:16.725 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:18.703 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:23.509 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:24.280 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:25.075 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:40.471 INFO:teuthology.orchestra.run.smithi156.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:52.440 INFO:teuthology.orchestra.run.smithi156.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:46:53.326 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:47:00.128 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:47:00.446 INFO:teuthology.orchestra.run.smithi156.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:48:18.246 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:48:25.722 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.254 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:48:25.729 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.267 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:48:25.744 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.271 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:48:25.748 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.273 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:48:25.750 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.282 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:48:25.760 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.478 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:48:25.954 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.488 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:48:25.965 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:18.498 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:48:25.975 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:48:47.768 INFO:teuthology.orchestra.run.smithi156.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:48:51.788 INFO:teuthology.orchestra.run.smithi156.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:49:07.138 INFO:teuthology.orchestra.run.smithi156.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:49:15.110 INFO:teuthology.orchestra.run.smithi156.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:49:29.424 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:49:36.900 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.432 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:49:36.908 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.445 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:49:36.922 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.445 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:49:36.922 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.480 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:49:36.957 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.494 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:49:36.971 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.498 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:49:36.974 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.527 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:49:37.004 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:29.547 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:49:37.024 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:49:53.614 INFO:teuthology.orchestra.run.smithi156.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:50:35.017 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:50:42.493 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.029 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:50:42.505 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.046 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:50:42.523 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.065 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:50:42.542 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.084 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:50:42.562 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.091 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:50:42.569 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.132 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:50:42.609 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.153 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:50:42.630 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:50:35.161 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:50:42.637 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:51:00.319 INFO:teuthology.orchestra.run.smithi156.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:51:01.000 INFO:teuthology.orchestra.run.smithi156.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:52:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-27T22:53:30.538 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:53:38.013 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.543 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:53:38.018 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.550 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:53:38.027 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.551 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:53:38.028 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.553 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:53:38.030 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.558 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:53:38.035 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.660 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:53:38.137 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.663 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:53:38.140 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:53:30.708 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:53:38.184 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:56:33.330 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-11-27T22:56:34.144 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-11-27T22:56:39.259 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-11-27T22:56:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-11-27T22:57:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T22:57:45.585 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T22:57:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T22:57:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-27T22:57:51.992 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:57:59.467 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.035 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:57:59.510 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.042 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:57:59.519 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.044 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:57:59.521 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.049 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:57:59.526 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.094 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:57:59.571 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.168 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:57:59.638 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.170 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:57:59.645 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:57:52.207 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:57:59.684 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:26.873 INFO:teuthology.orchestra.run.smithi156.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-11-27T22:58:27.338 INFO:teuthology.orchestra.run.smithi156.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-11-27T22:58:42.343 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:58:49.819 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.354 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:58:49.830 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.363 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:58:49.840 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.371 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:58:49.848 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.371 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:58:49.848 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.375 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:58:49.852 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.424 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:07:58:49.901 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.425 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:07:58:49.902 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T22:58:42.445 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:07:58:49.920 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:45.748 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:03:45.736+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.934011+0000 front 2019-11-27T23:03:03.001508+0000 (oldest deadline 2019-11-27T23:03:45.205707+0000) 2019-11-27T23:03:45.756 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:03:45.745+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:02:59.602248+0000 front 2019-11-27T23:02:59.522179+0000 (oldest deadline 2019-11-27T23:03:45.397510+0000) 2019-11-27T23:03:46.727 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:03:46.721+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.934011+0000 front 2019-11-27T23:03:03.001508+0000 (oldest deadline 2019-11-27T23:03:45.205707+0000) 2019-11-27T23:03:46.786 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:03:46.782+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:02:59.602248+0000 front 2019-11-27T23:02:59.522179+0000 (oldest deadline 2019-11-27T23:03:45.397510+0000) 2019-11-27T23:03:47.011 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:03:47.000+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:04.164909+0000 front 2019-11-27T23:03:04.162145+0000 (oldest deadline 2019-11-27T23:03:46.449279+0000) 2019-11-27T23:03:47.026 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:03:47.021+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:01.567545+0000 front 2019-11-27T23:03:01.446255+0000 (oldest deadline 2019-11-27T23:03:46.523028+0000) 2019-11-27T23:03:47.497 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:03:47.491+0000 1694c700 -1 osd.3 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:03.358048+0000 front 2019-11-27T23:03:03.323247+0000 (oldest deadline 2019-11-27T23:03:46.566961+0000) 2019-11-27T23:03:47.755 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:03:47.752+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.934011+0000 front 2019-11-27T23:03:03.001508+0000 (oldest deadline 2019-11-27T23:03:45.205707+0000) 2019-11-27T23:03:47.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:03:47.757+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:02:59.602248+0000 front 2019-11-27T23:02:59.522179+0000 (oldest deadline 2019-11-27T23:03:45.397510+0000) 2019-11-27T23:03:48.021 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:03:48.012+0000 1694c700 -1 osd.5 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.373255+0000 front 2019-11-27T23:03:02.377181+0000 (oldest deadline 2019-11-27T23:03:46.986740+0000) 2019-11-27T23:03:48.056 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:03:48.053+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:04.164909+0000 front 2019-11-27T23:03:04.162145+0000 (oldest deadline 2019-11-27T23:03:46.449279+0000) 2019-11-27T23:03:48.078 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:03:48.075+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:01.567545+0000 front 2019-11-27T23:03:01.446255+0000 (oldest deadline 2019-11-27T23:03:46.523028+0000) 2019-11-27T23:03:48.510 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:03:48.507+0000 1694c700 -1 osd.3 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:03.358048+0000 front 2019-11-27T23:03:03.323247+0000 (oldest deadline 2019-11-27T23:03:46.566961+0000) 2019-11-27T23:03:48.756 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:03:48.753+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.934011+0000 front 2019-11-27T23:03:03.001508+0000 (oldest deadline 2019-11-27T23:03:45.205707+0000) 2019-11-27T23:03:48.784 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:03:48.771+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:02:59.602248+0000 front 2019-11-27T23:02:59.522179+0000 (oldest deadline 2019-11-27T23:03:45.397510+0000) 2019-11-27T23:03:48.916 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:03:48.905+0000 1694c700 -1 osd.0 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.883891+0000 front 2019-11-27T23:03:02.885612+0000 (oldest deadline 2019-11-27T23:03:48.750330+0000) 2019-11-27T23:03:49.061 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:03:49.058+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:04.164909+0000 front 2019-11-27T23:03:04.162145+0000 (oldest deadline 2019-11-27T23:03:46.449279+0000) 2019-11-27T23:03:49.070 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:03:49.066+0000 1694c700 -1 osd.5 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:02.373255+0000 front 2019-11-27T23:03:02.377181+0000 (oldest deadline 2019-11-27T23:03:46.986740+0000) 2019-11-27T23:03:49.104 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:03:49.090+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:01.567545+0000 front 2019-11-27T23:03:01.446255+0000 (oldest deadline 2019-11-27T23:03:46.523028+0000) 2019-11-27T23:03:49.469 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:03:49.467+0000 1694c700 -1 osd.3 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:03.358048+0000 front 2019-11-27T23:03:03.323247+0000 (oldest deadline 2019-11-27T23:03:46.566961+0000) 2019-11-27T23:03:50.071 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:03:50.063+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:04.164909+0000 front 2019-11-27T23:03:04.162145+0000 (oldest deadline 2019-11-27T23:03:46.449279+0000) 2019-11-27T23:03:50.117 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:03:50.113+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:01.567545+0000 front 2019-11-27T23:03:01.446255+0000 (oldest deadline 2019-11-27T23:03:46.523028+0000) 2019-11-27T23:03:50.421 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:03:50.419+0000 1694c700 -1 osd.3 135 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:03:03.358048+0000 front 2019-11-27T23:03:03.323247+0000 (oldest deadline 2019-11-27T23:03:46.566961+0000) 2019-11-27T23:03:50.437 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:03:57.912 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.442 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:03:57.918 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.460 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:03:57.937 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.461 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:03:57.938 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.462 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:03:57.939 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:03:57.946 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.655 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:03:58.130 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.685 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:03:58.162 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:03:50.703 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:03:58.180 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:04:06.974 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:06.965+0000 32785700 -1 osd.2 141 build_incremental_map_msg missing incremental map 141 2019-11-27T23:04:07.216 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:07.202+0000 3578b700 -1 osd.2 141 build_incremental_map_msg missing incremental map 141 2019-11-27T23:04:07.503 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:07.386+0000 31f84700 -1 osd.2 141 build_incremental_map_msg missing incremental map 141 2019-11-27T23:04:37.014 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:37.009+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:37.984 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:37.982+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:38.945 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:38.943+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:39.967 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:39.963+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:40.922 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:40.921+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:41.970 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:41.968+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:42.946 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:42.944+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:43.961 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:43.960+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:44.954 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:44.952+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:46.004 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:46.002+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:46.976 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:46.975+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:47.068 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:04:47.064+0000 1694c700 -1 osd.6 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.289779+0000 front 2019-11-27T23:04:05.385718+0000 (oldest deadline 2019-11-27T23:04:46.952555+0000) 2019-11-27T23:04:48.018 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:48.016+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:48.113 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:04:48.109+0000 1694c700 -1 osd.6 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.289779+0000 front 2019-11-27T23:04:05.385718+0000 (oldest deadline 2019-11-27T23:04:46.952555+0000) 2019-11-27T23:04:48.407 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:04:48.404+0000 1694c700 -1 osd.0 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:04.305544+0000 front 2019-11-27T23:04:04.493666+0000 (oldest deadline 2019-11-27T23:04:48.335980+0000) 2019-11-27T23:04:49.040 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:49.038+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:49.093 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:04:49.089+0000 1694c700 -1 osd.1 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:07.149729+0000 front 2019-11-27T23:04:07.175005+0000 (oldest deadline 2019-11-27T23:04:49.071994+0000) 2019-11-27T23:04:49.142 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:04:49.139+0000 1694c700 -1 osd.6 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.289779+0000 front 2019-11-27T23:04:05.385718+0000 (oldest deadline 2019-11-27T23:04:46.952555+0000) 2019-11-27T23:04:49.422 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:04:49.395+0000 1694c700 -1 osd.0 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:04.305544+0000 front 2019-11-27T23:04:04.493666+0000 (oldest deadline 2019-11-27T23:04:48.335980+0000) 2019-11-27T23:04:49.523 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:49.520+0000 1694c700 -1 osd.4 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.984615+0000 front 2019-11-27T23:04:05.904183+0000 (oldest deadline 2019-11-27T23:04:49.132908+0000) 2019-11-27T23:04:49.533 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:49.529+0000 1694c700 -1 osd.4 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:49.600 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:04:49.597+0000 1694c700 -1 osd.3 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.339596+0000 front 2019-11-27T23:04:05.342283+0000 (oldest deadline 2019-11-27T23:04:49.416016+0000) 2019-11-27T23:04:50.062 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:50.060+0000 1694c700 -1 osd.2 142 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e140) 2019-11-27T23:04:50.122 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:04:50.120+0000 1694c700 -1 osd.1 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:07.149729+0000 front 2019-11-27T23:04:07.175005+0000 (oldest deadline 2019-11-27T23:04:49.071994+0000) 2019-11-27T23:04:50.172 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:04:50.170+0000 1694c700 -1 osd.6 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.289779+0000 front 2019-11-27T23:04:05.385718+0000 (oldest deadline 2019-11-27T23:04:46.952555+0000) 2019-11-27T23:04:50.463 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:04:50.460+0000 1694c700 -1 osd.0 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:04.305544+0000 front 2019-11-27T23:04:04.493666+0000 (oldest deadline 2019-11-27T23:04:48.335980+0000) 2019-11-27T23:04:50.559 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:50.555+0000 1694c700 -1 osd.4 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.984615+0000 front 2019-11-27T23:04:05.904183+0000 (oldest deadline 2019-11-27T23:04:49.132908+0000) 2019-11-27T23:04:50.560 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:50.557+0000 1694c700 -1 osd.4 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:50.639 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:04:50.637+0000 1694c700 -1 osd.3 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.339596+0000 front 2019-11-27T23:04:05.342283+0000 (oldest deadline 2019-11-27T23:04:49.416016+0000) 2019-11-27T23:04:50.973 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:04:50.940+0000 37f90700 -1 osd.2 143 build_incremental_map_msg missing incremental map 141 2019-11-27T23:04:51.191 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:04:51.189+0000 1694c700 -1 osd.6 142 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:04:05.289779+0000 front 2019-11-27T23:04:05.385718+0000 (oldest deadline 2019-11-27T23:04:46.952555+0000) 2019-11-27T23:04:51.515 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:51.514+0000 1694c700 -1 osd.4 143 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:52.611 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:52.582+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:53.579 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:53.577+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:54.598 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:54.597+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:55.588 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:55.588+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:56.641 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:56.640+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:57.657 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:57.656+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:58.661 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:58.661+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:04:59.691 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:04:59.689+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:00.661 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:00.661+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:01.683 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:01.682+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:02.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:02.688+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:03.735 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:03.734+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:04.753 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:04.751+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:05.741 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:05.740+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:06.750 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:06.749+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:07.770 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:07.769+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:08.796 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:08.796+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:09.769 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:09.767+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:10.773 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:10.772+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:11.823 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:11.821+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:12.847 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:12.846+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:13.868 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:13.867+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:14.868 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:14.866+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:15.915 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:15.914+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:16.938 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:16.937+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:17.895 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:17.894+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:18.930 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:18.928+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:19.983 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:19.983+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:20.996 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:20.994+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:21.961 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:21.959+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:22.915 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:22.914+0000 1694c700 -1 osd.4 144 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:23.883 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:05:23.877+0000 1694c700 -1 osd.4 145 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:121862 5.e 5:7759931f:::notify.3:head [watch ping cookie 821120544 gen 36] snapc 0=[] ondisk+write+known_if_redirected e142) 2019-11-27T23:05:24.250 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:05:24.206+0000 20e22700 -1 RGWWatcher::handle_error cookie 821120544 err (107) Transport endpoint is not connected 2019-11-27T23:06:13.768 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:06:21.244 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.777 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:06:21.253 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.788 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:06:21.265 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.792 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:06:21.269 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.811 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:06:21.288 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.822 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:06:21.299 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.906 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:06:21.382 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.945 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:06:21.421 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:06:13.958 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:06:21.435 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:14.278 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:07:14.274+0000 1694c700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:28.906004+0000 front 2019-11-27T23:06:28.922781+0000 (oldest deadline 2019-11-27T23:07:14.106363+0000) 2019-11-27T23:07:15.332 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:07:15.321+0000 1694c700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:28.906004+0000 front 2019-11-27T23:06:28.922781+0000 (oldest deadline 2019-11-27T23:07:14.106363+0000) 2019-11-27T23:07:15.969 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:07:15.965+0000 1694c700 -1 osd.0 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:31.304297+0000 front 2019-11-27T23:06:31.813137+0000 (oldest deadline 2019-11-27T23:07:15.275531+0000) 2019-11-27T23:07:16.326 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:07:16.323+0000 1694c700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:28.906004+0000 front 2019-11-27T23:06:28.922781+0000 (oldest deadline 2019-11-27T23:07:14.106363+0000) 2019-11-27T23:07:16.643 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:07:16.639+0000 1694c700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.675270+0000 front 2019-11-27T23:06:32.670974+0000 (oldest deadline 2019-11-27T23:07:15.950961+0000) 2019-11-27T23:07:16.942 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:07:16.940+0000 1694c700 -1 osd.0 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:31.304297+0000 front 2019-11-27T23:06:31.813137+0000 (oldest deadline 2019-11-27T23:07:15.275531+0000) 2019-11-27T23:07:16.987 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:07:16.984+0000 1694c700 -1 osd.7 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.090408+0000 front 2019-11-27T23:06:32.009078+0000 (oldest deadline 2019-11-27T23:07:16.090505+0000) 2019-11-27T23:07:17.136 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:07:17.132+0000 1694c700 -1 osd.4 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:30.614372+0000 front 2019-11-27T23:06:30.634854+0000 (oldest deadline 2019-11-27T23:07:16.506995+0000) 2019-11-27T23:07:17.228 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:07:17.220+0000 1694c700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.931409+0000 front 2019-11-27T23:06:32.798695+0000 (oldest deadline 2019-11-27T23:07:16.861274+0000) 2019-11-27T23:07:17.311 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:07:17.308+0000 1694c700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:28.906004+0000 front 2019-11-27T23:06:28.922781+0000 (oldest deadline 2019-11-27T23:07:14.106363+0000) 2019-11-27T23:07:17.602 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:07:17.600+0000 1694c700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.675270+0000 front 2019-11-27T23:06:32.670974+0000 (oldest deadline 2019-11-27T23:07:15.950961+0000) 2019-11-27T23:07:17.915 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:07:17.911+0000 1694c700 -1 osd.0 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:31.304297+0000 front 2019-11-27T23:06:31.813137+0000 (oldest deadline 2019-11-27T23:07:15.275531+0000) 2019-11-27T23:07:18.002 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:07:17.998+0000 1694c700 -1 osd.7 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.090408+0000 front 2019-11-27T23:06:32.009078+0000 (oldest deadline 2019-11-27T23:07:16.090505+0000) 2019-11-27T23:07:18.097 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:07:18.092+0000 1694c700 -1 osd.6 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.051504+0000 front 2019-11-27T23:06:32.053861+0000 (oldest deadline 2019-11-27T23:07:17.890212+0000) 2019-11-27T23:07:18.118 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:07:18.113+0000 1694c700 -1 osd.4 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:30.614372+0000 front 2019-11-27T23:06:30.634854+0000 (oldest deadline 2019-11-27T23:07:16.506995+0000) 2019-11-27T23:07:18.219 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:07:18.216+0000 1694c700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.931409+0000 front 2019-11-27T23:06:32.798695+0000 (oldest deadline 2019-11-27T23:07:16.861274+0000) 2019-11-27T23:07:18.310 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:07:18.308+0000 1694c700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:28.906004+0000 front 2019-11-27T23:06:28.922781+0000 (oldest deadline 2019-11-27T23:07:14.106363+0000) 2019-11-27T23:07:18.558 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:07:18.555+0000 1694c700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.675270+0000 front 2019-11-27T23:06:32.670974+0000 (oldest deadline 2019-11-27T23:07:15.950961+0000) 2019-11-27T23:07:19.086 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:07:19.084+0000 1694c700 -1 osd.4 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:30.614372+0000 front 2019-11-27T23:06:30.634854+0000 (oldest deadline 2019-11-27T23:07:16.506995+0000) 2019-11-27T23:07:19.114 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:07:19.112+0000 1694c700 -1 osd.6 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.051504+0000 front 2019-11-27T23:06:32.053861+0000 (oldest deadline 2019-11-27T23:07:17.890212+0000) 2019-11-27T23:07:19.228 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:07:19.225+0000 1694c700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:06:32.931409+0000 front 2019-11-27T23:06:32.798695+0000 (oldest deadline 2019-11-27T23:07:16.861274+0000) 2019-11-27T23:07:53.078 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:08:00.554 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.088 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:08:00.563 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.098 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:08:00.575 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.102 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:08:00.579 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.106 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:08:00.583 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.111 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:08:00.588 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.225 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:08:00.702 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.278 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:08:00.755 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:07:53.297 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:08:00.772 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:08:16.627 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:16.623+0000 1694c700 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:17.368 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:17.365+0000 1694c700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:17.393 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:17.390+0000 1694c700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:17.435 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:17.430+0000 1694c700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:17.591 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:17.587+0000 1694c700 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:17.956 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:17.953+0000 1694c700 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:18.050 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:18.048+0000 1694c700 -1 osd.1 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:18.413 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:18.372+0000 1694c700 -1 osd.6 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:18.465 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:18.462+0000 1694c700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:18.473 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:18.396+0000 1694c700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:18.572 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:18.561+0000 114ab700 -1 osd.6 153 build_incremental_map_msg missing incremental map 153 2019-11-27T23:08:18.574 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:18.569+0000 124ad700 -1 osd.6 153 build_incremental_map_msg missing incremental map 153 2019-11-27T23:08:18.637 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:18.631+0000 1694c700 -1 osd.4 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:18.993 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:18.989+0000 1694c700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:19.065 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:19.063+0000 1694c700 -1 osd.1 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:19.411 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:19.409+0000 1694c700 -1 osd.6 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:19.426 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:19.422+0000 1694c700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:19.499 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:19.479+0000 1694c700 -1 osd.0 153 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:19.712 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:19.677+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:19.981 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:19.975+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:20.028 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:20.026+0000 1694c700 -1 osd.1 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:20.421 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:20.417+0000 1694c700 -1 osd.6 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:20.443 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:20.441+0000 1694c700 -1 osd.3 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:20.538 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:20.532+0000 1694c700 -1 osd.0 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:20.653 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:20.651+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:20.973 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:20.972+0000 1694c700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:21.075 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:21.073+0000 1694c700 -1 osd.1 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:21.444 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:21.415+0000 1694c700 -1 osd.3 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:21.455 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:21.452+0000 1694c700 -1 osd.6 154 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:21.545 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:21.540+0000 1694c700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:21.648 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:21.642+0000 1694c700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:21.936 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:21.934+0000 1694c700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:22.097 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:22.095+0000 1694c700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:22.477 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:22.473+0000 1694c700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:22.566 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:22.563+0000 1694c700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:22.629 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:22.628+0000 1694c700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:22.696 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:22.690+0000 1694c700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:22.996 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:22.993+0000 1694c700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:23.056 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:23.053+0000 1694c700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:23.499 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:23.497+0000 1694c700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:23.591 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:23.589+0000 1694c700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:23.627 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:23.624+0000 1694c700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:23.692 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:08:23.690+0000 1694c700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:34.149197+0000 front 2019-11-27T23:07:31.425411+0000 (oldest deadline 2019-11-27T23:08:17.272928+0000) 2019-11-27T23:08:24.047 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:08:24.045+0000 1694c700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.532362+0000 front 2019-11-27T23:07:36.005579+0000 (oldest deadline 2019-11-27T23:08:17.210940+0000) 2019-11-27T23:08:24.050 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:08:24.047+0000 1694c700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:31.280278+0000 front 2019-11-27T23:07:34.142971+0000 (oldest deadline 2019-11-27T23:08:17.101477+0000) 2019-11-27T23:08:24.462 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:08:24.461+0000 1694c700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:33.925807+0000 front 2019-11-27T23:07:33.535947+0000 (oldest deadline 2019-11-27T23:08:16.882907+0000) 2019-11-27T23:08:24.610 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:24.608+0000 1694c700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:30.862025+0000 front 2019-11-27T23:07:31.337276+0000 (oldest deadline 2019-11-27T23:08:15.592816+0000) 2019-11-27T23:08:24.610 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:24.609+0000 1694c700 -1 osd.4 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:24.634 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:08:24.632+0000 1694c700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:07:36.441589+0000 front 2019-11-27T23:07:35.539340+0000 (oldest deadline 2019-11-27T23:08:16.520939+0000) 2019-11-27T23:08:25.859 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:25.805+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:26.810 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:26.807+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:27.836 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:27.833+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:28.832 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:28.830+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:29.837 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:29.835+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:30.870 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:30.869+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:31.862 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:31.860+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:32.902 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:32.901+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:33.953 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:33.950+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:34.976 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:34.968+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:35.985 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:35.983+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:37.035 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:37.033+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:38.017 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:38.014+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:39.011 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:39.009+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:40.033 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:40.032+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:41.012 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:41.010+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:42.061 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:42.059+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:43.043 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:43.041+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:44.038 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:44.037+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:45.070 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:45.069+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:46.099 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:46.098+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:47.142 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:47.141+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:48.171 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:48.170+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:49.189 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:49.188+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:50.163 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:50.162+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:51.119 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:51.118+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:52.078 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:52.078+0000 1694c700 -1 osd.4 157 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:53.102 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:08:53.079+0000 1694c700 -1 osd.4 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122228 5.e 5:7759931f:::notify.3:head [watch ping cookie 5424047104 gen 1] snapc 0=[] ondisk+write+known_if_redirected e152) 2019-11-27T23:08:53.588 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:08:53.462+0000 20e22700 -1 RGWWatcher::handle_error cookie 5424047104 err (107) Transport endpoint is not connected 2019-11-27T23:08:57.004 INFO:teuthology.orchestra.run.smithi156.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-11-27T23:09:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-11-27T23:09:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-11-27T23:09:39.788 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:09:39.745+0000 35f8c700 -1 osd.1 159 build_incremental_map_msg missing incremental map 159 2019-11-27T23:09:40.007 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:09:39.994+0000 31783700 -1 osd.0 159 build_incremental_map_msg missing incremental map 159 2019-11-27T23:09:48.643 INFO:teuthology.orchestra.run.smithi156.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:03.976 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:29.833 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:37.099 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:39.671 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:39.863 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:39.859+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:39.909 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:39.906+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:39.985 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:39.983+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:40.112 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:40.108+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:40.879 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:40.877+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:40.934 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:40.933+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:41.013 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:41.010+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:41.114 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:41.110+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:41.199 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:41.197+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:41.879 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:41.876+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:41.915 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:41.913+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:41.978 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:41.976+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:42.057 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:42.053+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:42.166 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:42.164+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:42.240 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:42.238+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:42.741 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:42.737+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:42.866 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:42.862+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:42.969 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:42.966+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:42.998 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:42.995+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:43.034 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:43.031+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:43.129 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:43.126+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:43.270 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:43.267+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:43.753 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:43.750+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:43.825 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:43.823+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:43.969 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:43.967+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:43.992 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:43.989+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:44.054 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:44.052+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:44.167 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:44.165+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:44.245 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:44.243+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:44.577 INFO:teuthology.orchestra.run.smithi156.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:44.732 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:44.730+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:44.876 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:44.873+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:44.936 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:44.934+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:45.012 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:45.009+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:45.048 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:45.043+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:45.162 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:45.158+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:45.220 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:45.218+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:45.767 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:45.761+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:45.872 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:45.871+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:45.905 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:45.903+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:46.002 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:46.000+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:46.024 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:46.021+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:46.181 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:46.179+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:46.202 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:46.199+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:46.740 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:46.738+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:46.888 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:46.884+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:46.936 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:46.934+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:46.986 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:46.983+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:46.998 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:46.997+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:47.179 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:47.176+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:47.179 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:47.177+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:47.729 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:47.727+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:47.926 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:47.923+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:47.978 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:47.975+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:47.980 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:47.977+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:48.037 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:48.034+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:48.145 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:48.144+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:48.173 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:48.171+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:48.724 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:48.721+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:48.932 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:48.929+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:48.946 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:48.944+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:48.985 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:48.983+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:49.084 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:49.081+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:49.131 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:49.128+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:49.161 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:49.158+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:49.693 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:10:49.692+0000 1694c700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.493252+0000 front 2019-11-27T23:09:58.189678+0000 (oldest deadline 2019-11-27T23:10:42.261253+0000) 2019-11-27T23:10:49.982 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:49.980+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:49.997 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:49.994+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:50.031 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:50.029+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:50.084 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:50.082+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:50.162 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:50.159+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:50.189 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:50.186+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:50.967 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:50.964+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:51.007 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:51.003+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:51.028 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:51.025+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:51.132 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:51.128+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:51.170 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:51.167+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:51.197 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:51.194+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:51.960 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:51.958+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:52.018 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:52.014+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:52.047 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:52.045+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:52.104 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:52.100+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:52.172 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:52.169+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:52.231 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:52.228+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:52.985 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:52.987 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:52.983+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:53.035 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:53.031+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:53.041 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:53.039+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:53.121 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:53.112+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:53.148 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:53.144+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:53.252 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:53.250+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:53.992 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:53.989+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:54.065 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:54.061+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:54.078 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:10:54.075+0000 1694c700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.084567+0000 front 2019-11-27T23:09:57.048628+0000 (oldest deadline 2019-11-27T23:10:41.682951+0000) 2019-11-27T23:10:54.135 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:10:54.130+0000 1694c700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.039301+0000 front 2019-11-27T23:09:59.012525+0000 (oldest deadline 2019-11-27T23:10:39.500700+0000) 2019-11-27T23:10:54.173 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:54.171+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:54.235 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:54.232+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:10:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:55.025 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:10:55.022+0000 1694c700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:59.063457+0000 front 2019-11-27T23:09:57.841217+0000 (oldest deadline 2019-11-27T23:10:39.023600+0000) 2019-11-27T23:10:55.084 INFO:teuthology.orchestra.run.smithi156.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-11-27T23:10:55.091 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:10:55.089+0000 1694c700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.897321+0000 front 2019-11-27T23:09:59.041166+0000 (oldest deadline 2019-11-27T23:10:38.931830+0000) 2019-11-27T23:10:55.135 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:10:55.133+0000 1694c700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:58.284152+0000 front 2019-11-27T23:09:58.135201+0000 (oldest deadline 2019-11-27T23:10:39.168960+0000) 2019-11-27T23:10:55.274 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:10:55.272+0000 1694c700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:09:57.334806+0000 front 2019-11-27T23:09:57.777902+0000 (oldest deadline 2019-11-27T23:10:40.701666+0000) 2019-11-27T23:11:45.218 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:11:52.694 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.231 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:11:52.705 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.234 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:11:52.711 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.239 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:11:52.716 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.247 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:11:52.724 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.252 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:11:52.729 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.471 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:11:52.947 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.579 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:11:53.056 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:45.583 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:11:53.059 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:11:46.686 INFO:teuthology.orchestra.run.smithi156.stderr:testFileCreate (test.functional.tests.TestFile) ... ok 2019-11-27T23:11:47.708 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:47.671+0000 114ab700 -1 osd.6 164 build_incremental_map_msg missing incremental map 164 2019-11-27T23:11:50.078 INFO:teuthology.orchestra.run.smithi156.stderr:testGetContentType (test.functional.tests.TestFile) ... ok 2019-11-27T23:11:51.399 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:51.398+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:51.399 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:51.399+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:52.167 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:52.163+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:52.300 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:52.297+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:52.362 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:52.360+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:52.362 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:52.361+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:52.945 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:52.942+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:53.015 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:53.013+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:53.207 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:53.204+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:53.325 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:53.322+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:53.350 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:53.349+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:53.357 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:53.357+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:53.953 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:53.950+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:54.066 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:54.064+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:54.193 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:54.190+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:54.324 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:54.322+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:54.380 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:54.379+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:54.383 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:54.383+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:54.936 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:54.934+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:55.065 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:55.063+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:55.182 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:55.179+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:55.294 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:55.291+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:55.378 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:55.372+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:55.379 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:55.378+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:55.902 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:55.899+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:56.048 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:56.046+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:56.225 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:56.222+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:56.338 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:56.334+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:56.354 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:56.351+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:56.355 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:56.353+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:56.946 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:56.943+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:57.077 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:57.074+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:57.193 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:57.191+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:57.317 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:57.313+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:57.353 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:57.352+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:57.355 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:57.355+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:57.940 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:57.938+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:58.110 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:58.109+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:58.205 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:58.202+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:58.316 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:58.313+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:58.320 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:58.317+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:58.320 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:58.319+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:58.959 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:58.955+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:11:59.167 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:11:59.160+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:11:59.210 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:11:59.208+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:11:59.344 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:59.343+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:11:59.345 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:11:59.344+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:11:59.364 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:11:59.361+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:11:59.990 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:11:59.988+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:00.150 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:00.147+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:00.262 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:00.259+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:00.359 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:00.357+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:00.362 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:00.361+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:00.409 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:00.404+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:00.997 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:00.993+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:01.191 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:01.190+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:01.269 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:01.267+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:01.352 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:01.351+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:01.354 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:01.353+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:01.449 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:01.446+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:01.971 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:01.969+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:02.181 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:02.179+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:02.281 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:02.276+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:02.319 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:02.317+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:02.322 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:02.321+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:02.431 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:02.428+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:03.023 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:03.021+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:03.154 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:03.153+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:03.331 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:03.328+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:03.368 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:03.363+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:03.368 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:03.366+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:03.402 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:03.399+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:04.007 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:04.005+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:04.193 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:04.192+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:04.314 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:04.310+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:04.374 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:04.371+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:04.407 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:04.405+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:04.410 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:04.410+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:04.976 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:04.973+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:05.200 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:05.199+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:05.309 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:05.307+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:05.422 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:05.420+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:05.436 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:05.433+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:05.436 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:05.435+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:06.012 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:06.008+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:06.250 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:06.248+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:06.296 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:06.292+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:06.389 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:06.387+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:06.430 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:06.427+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:06.430 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:06.429+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:07.027 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:07.024+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:07.211 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:07.209+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:07.270 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:07.268+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:07.373 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:07.371+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:07.396 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:07.393+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:07.398 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:07.397+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:08.054 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:08.051+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:08.229 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:08.225+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:08.253 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:08.251+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:08.361 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:08.358+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:08.372 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:08.369+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:08.373 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:08.370+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:09.079 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:09.076+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:09.270 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:09.268+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:09.275 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:09.271+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:09.396 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:09.393+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:09.412 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:09.407+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:09.413 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:09.410+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:10.128 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:10.125+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:10.236 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:10.231+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:10.241 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:10.238+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:10.370 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:10.367+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:10.371 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:10.368+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:10.416 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:10.413+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:11.094 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:11.092+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:11.191 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:11.188+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:11.214 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:11.211+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:11.337 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:11.334+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:11.338 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:11.336+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:11.401 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:11.397+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:12.118 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:12.116+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:12.208 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:12.205+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:12.270 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:12.266+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:12.367 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:12.362+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:12.368 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:12.365+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:12.434 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:12.431+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:13.125 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:13.123+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:13.182 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:13.179+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:13.323 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:13.320+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:13.338 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:13.334+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:13.339 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:13.336+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:13.436 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:13.433+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:14.092 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:14.089+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:14.172 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:14.169+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:14.300 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:14.297+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:14.319 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:14.315+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:14.320 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:14.317+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:14.488 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:12:14.481+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.543424+0000 front 2019-11-27T23:11:12.528272+0000 (oldest deadline 2019-11-27T23:11:51.306862+0000) 2019-11-27T23:12:15.104 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:12:15.101+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:10.147909+0000 front 2019-11-27T23:11:10.683818+0000 (oldest deadline 2019-11-27T23:11:52.603429+0000) 2019-11-27T23:12:15.188 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:15.186+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:15.294 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:15.292+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:15.334 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:15.331+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:07.808569+0000 front 2019-11-27T23:11:07.810280+0000 (oldest deadline 2019-11-27T23:11:51.257424+0000) 2019-11-27T23:12:15.335 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:15.332+0000 1694c700 -1 osd.4 165 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:16.246 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:12:16.235+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:12.371990+0000 front 2019-11-27T23:11:09.129437+0000 (oldest deadline 2019-11-27T23:11:52.348892+0000) 2019-11-27T23:12:16.283 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:12:16.281+0000 1694c700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:11:08.163561+0000 front 2019-11-27T23:11:08.066167+0000 (oldest deadline 2019-11-27T23:11:51.942051+0000) 2019-11-27T23:12:16.370 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:16.367+0000 1694c700 -1 osd.4 166 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:17.360 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:17.358+0000 1694c700 -1 osd.4 167 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:testGetOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T23:12:18.363 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:18.361+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:19.397 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:19.394+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:20.442 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:20.440+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:21.416 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:21.414+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:22.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:22.405+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:23.438 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:23.436+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:24.477 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:24.475+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:25.459 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:25.455+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:25.661 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:12:33.136 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.668 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:12:33.144 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.766 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:12:33.243 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.767 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:12:33.242 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.767 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:12:33.244 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.772 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:12:33.249 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.775 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:12:33.252 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.842 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:12:33.318 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:25.854 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:12:33.331 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:12:26.442 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:26.440+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:27.461 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:27.459+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:28.489 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:28.487+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:29.467 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:29.462+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:30.443 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:30.441+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:31.456 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:31.454+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:32.484 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:32.482+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:33.517 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:33.515+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:34.545 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:34.543+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:35.571 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:35.570+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:36.623 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:36.621+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:37.653 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:37.651+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:38.623 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:38.622+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:39.656 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:39.654+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:40.653 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:40.651+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:41.670 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:41.668+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:testHead (test.functional.tests.TestFile) ... ok 2019-11-27T23:12:42.662 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:42.661+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:43.209 INFO:teuthology.orchestra.run.smithi156.stderr:testHeadOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T23:12:43.637 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:43.634+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:44.600 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:44.599+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:45.599 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:45.597+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:46.644 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:46.644+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:47.696 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:12:47.696+0000 1694c700 -1 osd.4 168 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:122906 5.e 5:7759931f:::notify.3:head [watch ping cookie 1038856944 gen 1] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-27T23:12:48.456 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:12:48.339+0000 20e22700 -1 RGWWatcher::handle_error cookie 1038856944 err (107) Transport endpoint is not connected 2019-11-27T23:13:16.300 INFO:teuthology.orchestra.run.smithi156.stderr:testMetadataOnPost (test.functional.tests.TestFile) ... ok 2019-11-27T23:13:18.096 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:13:17.969+0000 37f90700 -1 osd.5 171 build_incremental_map_msg missing incremental map 171 2019-11-27T23:13:18.186 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:13:18.052+0000 31f84700 -1 osd.5 171 build_incremental_map_msg missing incremental map 171 2019-11-27T23:13:18.211 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:13:18.101+0000 3678d700 -1 osd.5 171 build_incremental_map_msg missing incremental map 171 2019-11-27T23:14:07.006 INFO:teuthology.orchestra.run.smithi156.stderr:testMetadataOnPut (test.functional.tests.TestFile) ... ok 2019-11-27T23:14:15.024 INFO:teuthology.orchestra.run.smithi156.stderr:testNameLimit (test.functional.tests.TestFile) ... ok 2019-11-27T23:14:15.514 INFO:teuthology.orchestra.run.smithi156.stderr:testNoContentLengthForPut (test.functional.tests.TestFile) ... ok 2019-11-27T23:14:17.197 INFO:teuthology.orchestra.run.smithi156.stderr:testPostOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-27T23:14:18.851 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:18.849+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:19.717 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:19.714+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:19.823 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:19.820+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:19.862 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:19.857+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:20.322 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:20.320+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:20.739 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:20.736+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:20.806 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:20.802+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:20.825 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:20.823+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:21.323 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:21.321+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:21.543 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:21.540+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:21.598 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:21.594+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:21.749 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:21.747+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:21.844 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:21.842+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:21.854 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:21.852+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:22.372 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:22.369+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:22.480 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:22.477+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:22.531 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:22.528+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:22.559 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:22.558+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:22.804 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:22.800+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:22.822 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:22.819+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:22.835 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:22.832+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:23.380 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:23.378+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:23.442 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:23.439+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:23.581 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:23.579+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:23.603 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:23.601+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:23.785 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:23.782+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:23.791 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:23.789+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:23.799 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:23.796+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:24.399 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:24.395+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:24.427 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:24.425+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:24.560 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:24.558+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:24.632 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:24.630+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:24.753 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:24.749+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:24.825 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:24.822+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:24.840 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:24.837+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:25.387 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:25.383+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:25.388 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:25.385+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:25.521 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:25.518+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:25.637 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:25.635+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:25.714 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:25.711+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:25.839 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:25.837+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:25.874 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:25.871+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:26.396 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:26.389+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:26.436 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:26.435+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:26.539 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:26.535+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:26.643 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:26.640+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:26.739 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:26.737+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:26.841 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:26.838+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:26.890 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:26.889+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:27.431 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:27.428+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:27.458 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:27.456+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:27.544 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:27.541+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:27.692 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:27.690+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:27.721 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:27.719+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:27.793 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:27.792+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:27.882 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:27.880+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:28.414 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:28.410+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:28.465 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:28.463+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:28.526 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:28.523+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:28.666 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:28.663+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:28.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:28.752+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:28.762 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:28.760+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:28.898 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:28.895+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:29.373 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:29.369+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:29.442 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:29.439+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:29.499 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:29.496+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:29.653 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:29.650+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:29.762 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:29.760+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:29.795 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:29.792+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:29.946 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:29.943+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:30.356 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:30.353+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:30.440 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:30.435+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:30.528 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:30.526+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:30.620 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:30.617+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:30.771 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:30.768+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:30.775 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:30.772+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:30.948 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:30.945+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:31.374 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:31.372+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:31.456 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:31.454+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:31.548 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:31.545+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:31.601 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:31.598+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:31.729 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:31.727+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:31.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:31.756+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:31.915 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:31.913+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:32.365 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:32.362+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:32.448 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:32.446+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:32.508 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:32.505+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:32.615 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:32.613+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:32.699 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:32.696+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:32.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:32.749+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:32.869 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:32.867+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:33.359 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:33.356+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:33.442 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:33.439+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:33.537 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:33.534+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:33.618 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:33.615+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:33.742 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:33.739+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:33.746 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:33.744+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:33.827 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:33.825+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:34.400 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:34.397+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:34.445 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:34.441+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:34.503 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:34.500+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:34.657 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:34.654+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:34.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:34.751+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:34.764 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:34.762+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:34.807 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:34.801+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:35.438 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:35.435+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:35.456 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:35.454+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:35.531 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:35.527+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:35.647 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:35.644+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:35.750 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:35.748+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:35.783 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:35.781+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:35.784 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:35.782+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:36.398 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:14:43.873 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.405 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:14:43.881 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.440 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:14:43.917 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.451 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:14:43.928 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.455 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:14:43.931 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.466 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:14:43.943 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.470 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:36.467+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:36.478 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:36.475+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:36.570 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:36.569+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:36.606 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:14:44.082 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.643 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:14:44.119 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.660 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:14:44.136 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:14:36.662 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:36.656+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:36.748 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:36.746+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:36.774 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:36.771+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:36.820 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:36.819+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:37.425 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:37.422+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:37.531 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:37.529+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:37.598 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:37.597+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:37.646 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:37.643+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:37.719 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:37.717+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:37.789 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:37.787+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:37.810 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:37.807+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:38.389 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:38.385+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:38.574 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:38.572+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:38.589 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:38.587+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:38.676 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:38.673+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:38.744 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:38.740+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:38.747 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:38.745+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:38.782 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:38.778+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:39.404 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:39.401+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:39.562 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:39.557+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:39.616 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:39.613+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:39.640 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:39.637+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:39.745 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:39.741+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:39.766 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:39.763+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:39.784 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:39.780+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:40.437 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:40.434+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:40.539 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:40.535+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:40.645 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:40.642+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:40.681 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:14:40.672+0000 1694c700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.522017+0000 front 2019-11-27T23:13:36.511735+0000 (oldest deadline 2019-11-27T23:14:21.156274+0000) 2019-11-27T23:14:40.759 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:40.752+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:40.770 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:14:40.767+0000 1694c700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:33.681354+0000 front 2019-11-27T23:13:33.687322+0000 (oldest deadline 2019-11-27T23:14:19.463911+0000) 2019-11-27T23:14:40.833 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:40.829+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:41.487 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:14:41.485+0000 1694c700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.119267+0000 front 2019-11-27T23:13:37.066637+0000 (oldest deadline 2019-11-27T23:14:22.345981+0000) 2019-11-27T23:14:41.530 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:14:41.513+0000 1694c700 -1 osd.5 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.367930+0000 front 2019-11-27T23:13:37.812588+0000 (oldest deadline 2019-11-27T23:14:20.236947+0000) 2019-11-27T23:14:41.674 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:41.670+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:41.778 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:14:41.775+0000 1694c700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:36.820682+0000 front 2019-11-27T23:13:36.825509+0000 (oldest deadline 2019-11-27T23:14:19.099751+0000) 2019-11-27T23:14:41.797 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:41.795+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:42.636 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:14:42.632+0000 1694c700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:38.089732+0000 front 2019-11-27T23:13:37.470760+0000 (oldest deadline 2019-11-27T23:14:21.518261+0000) 2019-11-27T23:14:42.754 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:14:42.751+0000 1694c700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:13:37.291932+0000 front 2019-11-27T23:13:37.634091+0000 (oldest deadline 2019-11-27T23:14:18.335848+0000) 2019-11-27T23:14:47.967 INFO:teuthology.orchestra.run.smithi156.stderr:testRangedGets (test.functional.tests.TestFile) ... ok 2019-11-27T23:15:25.503 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:15:32.979 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.514 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:15:32.989 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.530 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:15:33.007 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.531 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:15:33.008 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.532 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:15:33.010 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.537 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:15:33.013 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.598 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:15:33.074 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.611 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:15:33.087 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:25.661 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:15:33.138 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:15:39.756 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:39.754+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:39.965 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:39.963+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:39.971 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:39.968+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:40.732 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:40.731+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:40.985 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:40.983+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:40.996 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:40.994+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:41.008 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:41.003+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:41.713 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:41.710+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:41.958 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:41.949+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:41.958 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:41.950+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:41.980 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:41.979+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:42.739 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:42.735+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:42.956 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:42.954+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:42.960 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:42.958+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:42.976 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:42.974+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:43.045 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:43.044+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:43.746 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:43.743+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:43.962 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:43.959+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:44.005 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:44.004+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:44.013 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:44.010+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:44.074 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:44.073+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:44.725 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:44.723+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:44.999 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:44.996+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:45.042 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:45.039+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:45.042 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:45.041+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:45.048 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:45.045+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:45.049 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:45.046+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:45.049 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:45.047+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:45.737 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:45.735+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:46.000 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:45.997+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:46.030 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:46.028+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:46.036 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:46.035+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:46.039 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:46.037+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:46.088 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:46.086+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:46.089 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:46.088+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:46.739 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:46.736+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:47.046 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:47.042+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:47.050 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:47.047+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:47.059 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:47.058+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:47.078 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:47.077+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:47.079 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:47.078+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:47.090 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:47.088+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:47.726 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:47.723+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:48.002 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:48.000+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:48.048 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:48.046+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:48.068 INFO:teuthology.orchestra.run.smithi156.stderr:testSerialization (test.functional.tests.TestFile) ... ok 2019-11-27T23:15:48.071 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:48.064+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:48.131 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:48.130+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:48.133 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:48.130+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:48.134 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:48.133+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:48.718 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:48.715+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:49.016 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:49.014+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:49.060 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:49.046+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:49.093 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:49.091+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:49.119 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:49.114+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:49.161 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:49.160+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:49.165 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:49.164+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:49.740 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:49.737+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:49.989 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:49.987+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:50.047 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:50.044+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:50.089 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:50.086+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:50.126 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:50.123+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:50.160 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:50.157+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:50.164 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:50.163+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:50.796 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:50.793+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:50.987 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:50.985+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:51.051 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:51.049+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:51.086 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:51.084+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:51.130 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:51.128+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:51.174 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:51.171+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:51.175 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:51.174+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:51.848 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:51.845+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:52.042 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:52.040+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:52.045 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:52.043+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:52.116 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:52.114+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:52.146 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:52.143+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:52.158 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:52.155+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:52.159 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:52.157+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:52.852 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:52.849+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:53.006 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:53.001+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:53.052 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:53.047+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:53.118 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:53.117+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:53.163 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:53.160+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:53.202 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:53.201+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:53.203 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:53.202+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:53.865 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:53.862+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:53.958 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:53.956+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:54.088 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:54.085+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:54.125 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:54.122+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:54.128 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:54.127+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:54.212 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:54.210+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:54.212 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:54.211+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:54.233 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:54.227+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:54.864 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:54.862+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:54.998 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:54.997+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:55.084 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:55.081+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:55.107 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:55.105+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:55.168 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:55.163+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:55.197 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:55.194+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:55.198 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:55.196+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:55.234 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:55.231+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:55.871 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:55.869+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:56.037 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:56.036+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:56.061 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:56.058+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:56.091 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:56.087+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:56.153 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:56.151+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:56.155 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:56.155+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:56.185 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:56.184+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:56.259 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:56.248+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:56.262 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:56.258+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:15:56.853 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:56.850+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:57.062 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:57.060+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:57.063 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:57.062+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:57.064 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:57.061+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:57.113 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:57.111+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:57.113 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:57.113+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:57.152 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:57.151+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:57.284 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:57.282+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:57.286 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:57.284+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:15:57.885 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:57.882+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:58.032 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:58.029+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:58.076 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:58.073+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:58.085 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:58.080+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:58.140 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:58.138+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:58.141 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:58.139+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:58.166 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:58.165+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:58.333 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:58.332+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:58.335 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:58.334+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:15:58.937 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:58.935+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:15:58.995 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:58.992+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:59.033 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:15:59.031+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:15:59.054 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:15:59.051+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:15:59.134 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:15:59.132+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:15:59.163 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:59.160+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:15:59.163 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:15:59.162+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:15:59.322 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:59.320+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:15:59.322 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:15:59.321+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:15:59.969 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:15:59.967+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:15:59.989 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:15:59.982+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:00.021 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:00.019+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:00.033 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:00.030+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:00.179 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:00.176+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:00.197 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:00.194+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:00.198 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:00.196+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:00.356 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:00.353+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:00.358 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:00.356+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:00.991 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:00.986+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:01.007 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:01.005+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:01.027 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:01.024+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:01.039 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:01.038+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:01.162 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:01.158+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:01.164 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:01.160+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:01.177 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:01.173+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:01.317 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:01.314+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:01.317 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:01.315+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:01.991 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:01.987+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:02.016 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:02.014+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:02.037 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:02.034+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:02.042 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:02.039+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:02.159 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:02.157+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:02.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:02.165+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:02.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:02.167+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:02.333 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:02.326+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:02.335 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:02.331+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:02.993 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:02.991+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:03.022 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:03.019+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:03.029 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:03.025+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:03.047 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:03.044+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:03.131 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:03.128+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:03.192 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:03.188+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:03.194 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:03.191+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:03.299 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:03.295+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:03.301 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:03.297+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:04.003 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:03.999+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:04.018 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:04.015+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:04.023 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:04.020+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:04.082 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:04.078+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:04.091 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:04.089+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:04.180 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:04.178+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:04.181 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:04.179+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:04.318 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:04.316+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:04.319 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:04.317+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:04.990 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:04.988+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:05.035 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:05.033+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:05.044 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:05.042+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:05.070 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:05.068+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:05.105 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:05.102+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:05.214 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:05.210+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:05.215 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:05.213+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:05.320 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:05.315+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:05.320 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:05.318+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:06.005 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:05.996+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:06.014 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:06.011+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:06.035 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:06.032+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:06.039 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:06.037+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:06.065 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:06.059+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:06.198 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:06.196+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:06.202 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:06.200+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:06.356 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:06.354+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:06.358 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:06.356+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:06.973 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:06.969+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:07.024 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:07.020+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:07.046 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:07.041+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:07.074 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:07.071+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:07.078 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:07.076+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:07.247 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:07.245+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:07.251 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:07.249+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:07.325 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:07.322+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:07.326 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:07.325+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:07.983 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:07.981+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:08.036 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:08.034+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:08.036 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:08.035+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:08.037 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:08.034+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:08.104 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:08.097+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:08.229 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:08.227+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:08.230 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:08.228+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:08.304 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:08.300+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:08.304 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:08.302+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:08.986 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:08.979+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:09.060 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:09.058+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:09.086 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:09.084+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:09.088 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:09.085+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:09.101 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:09.099+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:09.263 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:09.260+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:09.263 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:09.261+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:09.268 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:09.266+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:09.270 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:09.269+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:09.949 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:09.946+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:10.062 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:10.058+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:10.108 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:10.104+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:10.116 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:10.112+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:10.141 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:10.138+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:10.258 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:10.255+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:10.259 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:10.257+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:10.264 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:10.259+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:10.265 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:10.262+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:10.915 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:10.913+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:11.072 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:11.069+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:11.147 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:11.144+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:11.149 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:11.146+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:11.162 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:11.159+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:11.272 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:11.269+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:11.272 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:11.270+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:11.275 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:11.273+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:11.275 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:11.273+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:11.706 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:16:11.686+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 46sec e182 v182) 2019-11-27T23:16:11.952 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:11.948+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:12.102 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:12.099+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:12.166 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:12.164+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:12.181 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:12.178+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:12.183 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:12.178+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:12.282 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:12.280+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:12.284 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:12.283+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:12.326 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:12.323+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:12.327 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:12.325+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:12.994 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:12.991+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:13.152 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:13.149+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:13.173 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:13.170+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:13.173 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:13.170+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:13.205 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:13.203+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:13.317 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:13.316+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:13.319 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:13.318+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:13.327 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:13.325+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:13.328 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:13.326+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:13.976 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:13.973+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:14.151 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:14.149+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:14.196 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:14.194+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:14.207 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:14.204+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:14.229 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:14.227+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:14.274 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:14.270+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:14.275 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:14.272+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:14.369 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:14.366+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:14.370 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:14.368+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:14.949 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:14.946+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:15.163 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:15.160+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:15.229 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:15.227+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:15.246 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:15.244+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:15.259 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:15.253+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:15.259 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:15.255+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:15.271 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:15.269+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:15.412 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:15.408+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:15.413 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:15.411+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:15.926 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:15.923+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:16.145 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:16.138+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:16.222 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:16.219+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:16.223 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:16.220+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:16.248 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:16.245+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:16.263 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:16.261+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:16.277 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:16.274+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:16.405 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:16.403+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:16.406 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:16.403+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:16.704 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:16:16.703+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 46sec e182 v182) 2019-11-27T23:16:16.905 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:16.902+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:17.150 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:17.148+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:17.196 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:17.193+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:17.199 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:17.197+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:17.249 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:17.247+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:17.252 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:17.250+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:17.312 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:17.310+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:17.415 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:17.411+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:17.416 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:17.413+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:17.877 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:17.875+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:18.188 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:18.186+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:18.191 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:18.189+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:18.201 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:18.199+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:18.217 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:18.214+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:18.288 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:18.285+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:18.350 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:18.348+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:18.466 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:18.464+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:18.467 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:18.465+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:18.835 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:18.832+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:19.210 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:19.207+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:19.222 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:19.218+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:19.223 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:19.221+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:19.231 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:19.229+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:19.332 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:19.330+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:19.345 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:19.343+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:19.453 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:19.451+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:19.453 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:19.452+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:19.849 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:19.846+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:20.189 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:20.187+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:20.229 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:20.226+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:20.230 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:20.228+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:20.287 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:20.284+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:20.326 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:20.323+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:20.336 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:20.333+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:20.468 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:20.466+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:20.470 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:20.469+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:20.853 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:20.850+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:21.241 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:21.238+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:21.255 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:21.246+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:21.255 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:21.248+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:21.282 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:21.280+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:21.349 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:21.347+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:21.364 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:21.362+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:21.489 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:21.486+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:21.489 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:21.487+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:21.720 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:16:21.718+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 46sec e182 v182) 2019-11-27T23:16:21.876 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:21.874+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:22.231 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:22.228+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:22.234 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:22.232+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:22.265 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:22.262+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:22.323 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:22.320+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:22.334 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:22.330+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:22.365 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:22.363+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:22.468 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:22.464+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:22.469 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:22.466+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:22.914 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:22.912+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:23.234 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:23.232+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:23.235 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:23.233+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:23.265 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:23.263+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:23.306 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:23.304+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:23.309 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:23.307+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:23.339 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:23.337+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:23.465 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:23.463+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:23.465 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:23.464+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:23.934 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:23.931+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:24.231 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:24.227+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:24.254 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:24.252+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:24.257 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:24.256+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:24.260 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:24.257+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:24.282 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:24.279+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:24.382 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:24.379+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:24.445 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:24.442+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:24.445 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:24.444+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:24.911 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:24.908+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:25.217 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:25.215+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:25.244 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:25.241+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:25.246 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:25.244+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:25.256 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:25.251+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:25.258 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:25.257+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:25.373 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:25.372+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:25.486 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:25.483+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:25.487 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:25.484+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:25.924 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:25.922+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:26.205 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:26.203+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:26.207 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:26.205+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:26.213 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:26.210+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:26.303 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:26.302+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:26.307 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:26.306+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:26.412 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:26.408+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:26.477 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:26.473+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:26.477 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:26.475+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:26.742 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:16:26.740+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 46sec e182 v182) 2019-11-27T23:16:26.910 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:26.908+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:27.233 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:27.230+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:27.248 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:27.242+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:27.254 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:27.252+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:27.265 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:27.262+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:27.266 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:27.264+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:27.369 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:27.367+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:27.454 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:27.450+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:27.454 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:27.452+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:27.957 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:27.951+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:28.220 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:28.217+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:28.223 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:28.220+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:28.264 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:28.262+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:28.277 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:28.274+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:28.277 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:28.276+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:28.421 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:28.419+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:28.507 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:28.503+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:28.508 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:28.505+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:28.927 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:28.924+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:29.259 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:29.256+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:29.271 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:29.269+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:29.292 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:29.290+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:29.327 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:29.325+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:29.328 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:29.327+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:29.405 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:29.403+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:29.472 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:29.468+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:29.473 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:29.470+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:29.949 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:29.946+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:30.243 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:30.241+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:30.266 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:30.265+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:30.287 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:30.286+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:30.288 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:30.287+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:30.308 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:30.306+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:30.427 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:30.426+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:30.430 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:30.427+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:30.434 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:30.428+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:30.937 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:30.935+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:31.228 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:31.226+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:31.288 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:31.286+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:31.325 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:31.322+0000 1694c700 -1 osd.4 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.579134+0000 front 2019-11-27T23:14:55.580446+0000 (oldest deadline 2019-11-27T23:15:40.358380+0000) 2019-11-27T23:16:31.326 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:31.325+0000 1694c700 -1 osd.4 182 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:31.357 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:16:31.354+0000 1694c700 -1 osd.3 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.826673+0000 front 2019-11-27T23:14:54.230137+0000 (oldest deadline 2019-11-27T23:15:39.064781+0000) 2019-11-27T23:16:31.430 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:16:31.427+0000 1694c700 -1 osd.7 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.720816+0000 front 2019-11-27T23:14:58.765712+0000 (oldest deadline 2019-11-27T23:15:42.379515+0000) 2019-11-27T23:16:31.444 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:31.440+0000 1694c700 -1 osd.2 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:15:14.188437+0000 (oldest deadline 2019-11-27T23:15:54.188437+0000) 2019-11-27T23:16:31.445 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:16:31.443+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e180) 2019-11-27T23:16:31.816 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:16:31.814+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 46sec e182 v182) 2019-11-27T23:16:31.989 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:16:31.987+0000 1694c700 -1 osd.1 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:55.835085+0000 front 2019-11-27T23:14:55.827460+0000 (oldest deadline 2019-11-27T23:15:39.727165+0000) 2019-11-27T23:16:32.252 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:16:32.251+0000 1694c700 -1 osd.6 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:58.822789+0000 front 2019-11-27T23:14:58.730681+0000 (oldest deadline 2019-11-27T23:15:44.006651+0000) 2019-11-27T23:16:32.273 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:16:32.271+0000 1694c700 -1 osd.0 182 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:14:57.926734+0000 front 2019-11-27T23:14:58.924372+0000 (oldest deadline 2019-11-27T23:15:38.752621+0000) 2019-11-27T23:16:32.446 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:32.357+0000 1694c700 -1 osd.4 183 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:33.429 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:33.399+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:34.411 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:34.410+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:35.451 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:35.451+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:36.424 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:36.422+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:37.468 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:37.466+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:38.471 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:38.471+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:39.501 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:39.499+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:40.534 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:40.533+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:41.569 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:41.566+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:42.583 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:42.582+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:43.626 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:43.624+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:44.641 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:44.640+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:45.681 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:45.678+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:46.673 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:46.671+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:47.701 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:47.688+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:48.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:48.700+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:49.698 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:49.691+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:50.687 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:50.685+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:51.694 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:51.692+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:52.709 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:52.707+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:53.697 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:53.695+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:54.692 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:54.690+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:55.690 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:55.687+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:56.743 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:56.742+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:57.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:57.699+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:58.723 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:58.719+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:16:59.730 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:16:59.727+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:17:00.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:17:00.745+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:17:01.796 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:17:01.794+0000 1694c700 -1 osd.4 184 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:123641 5.e 5:7759931f:::notify.3:head [watch ping cookie 363552416 gen 1] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-11-27T23:17:03.006 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:17:02.942+0000 1694c700 -1 osd.4 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:123845 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 363552416 gen 2] snapc 0=[] ondisk+write+known_if_redirected e183) 2019-11-27T23:17:03.304 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:17:03.268+0000 20e22700 -1 RGWWatcher::handle_error cookie 363552416 err (107) Transport endpoint is not connected 2019-11-27T23:17:46.400 INFO:teuthology.orchestra.run.smithi156.stderr:testStackedOverwrite (test.functional.tests.TestFile) ... ok 2019-11-27T23:17:46.952 INFO:teuthology.orchestra.run.smithi156.stderr:testTooLongName (test.functional.tests.TestFile) ... ok 2019-11-27T23:17:51.423 INFO:teuthology.orchestra.run.smithi156.stderr:testZeroByteFile (test.functional.tests.TestFile) ... ok 2019-11-27T23:18:06.327 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:06.325+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:07.285 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:07.283+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:07.306 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:07.304+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:07.838 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:07.834+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:07.894 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:07.891+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:08.262 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:08.259+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:08.288 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:08.286+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:08.843 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:08.840+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:08.887 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:08.877+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:09.283 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:09.280+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:09.307 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:09.303+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:09.878 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:09.876+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:09.879 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:09.876+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:10.281 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:10.278+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:10.294 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:10.291+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:10.845 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:10.840+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:10.871 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:10.863+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:10.882 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:10.880+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:11.255 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:11.251+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:11.294 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:11.290+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:11.820 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:11.818+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:11.872 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:11.869+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:11.897 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:11.894+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:11.932 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:11.930+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:12.288 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:12.285+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:12.307 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:12.304+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:12.841 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:12.839+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:12.846 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:12.844+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:12.879 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:12.877+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:12.928 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:12.925+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:13.280 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:13.276+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:13.338 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:13.335+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:13.832 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:13.830+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:13.839 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:13.837+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:13.898 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:13.896+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:13.899 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:13.896+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:14.247 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:14.245+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:14.312 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:14.309+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:14.807 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:14.805+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:14.876 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:14.872+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:14.882 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:14.879+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:14.893 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:14.891+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:15.225 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:15.223+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:15.321 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:15.317+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:15.844 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:15.841+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:15.874 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:15.872+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:15.903 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:15.900+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:15.907 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:15.904+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:16.242 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:16.240+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:16.275 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:16.273+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:16.878 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:16.875+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:16.905 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:16.900+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:16.920 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:16.917+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:16.936 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:16.934+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:17.228 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:17.226+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:17.264 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:17.262+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:17.863 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:17.857+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:17.876 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:17.873+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:17.906 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:17.903+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:17.959 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:17.956+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:18.188 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:18.184+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:18.262 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:18.259+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:18.876 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:18.873+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:18.896 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:18.894+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:18.928 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:18.926+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:18.982 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:18.980+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:19.148 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:19.145+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:19.273 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:19.271+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:19.832 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:19.829+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:19.887 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:19.884+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:19.887 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:19.885+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:20.022 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:20.019+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:20.196 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:20.193+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:20.239 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:20.237+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:20.875 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:20.872+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:20.878 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:20.876+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:20.893 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:20.891+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:20.982 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:20.979+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:21.188 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:21.185+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:21.240 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:21.237+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:21.857 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:21.854+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:21.859 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:21.857+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:21.886 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:21.883+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:21.997 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:21.993+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:22.185 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:22.183+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:22.212 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:22.207+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:22.848 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:22.845+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:22.877 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:22.875+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:22.937 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:22.935+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:23.025 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:23.023+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:23.160 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:23.157+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:23.172 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:23.169+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:23.863 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:23.859+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:23.930 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:23.927+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:23.945 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:23.942+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:24.056 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:24.054+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:24.138 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:24.136+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:24.157 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:24.154+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:24.839 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:24.835+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:24.910 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:24.908+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:24.917 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:24.914+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:25.097 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:25.094+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:25.119 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:25.117+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:25.153 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:25.151+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:25.876 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:25.874+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:25.886 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:25.884+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:25.913 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:25.910+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:26.094 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:26.092+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:26.110 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:26.107+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:26.151 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:26.149+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:26.891 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:26.887+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:26.896 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:26.894+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:26.923 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:26.921+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:27.070 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:27.067+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:27.076 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:27.074+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:27.113 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:27.109+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:27.866 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:27.862+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:27.896 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:27.894+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:27.970 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:27.968+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:28.065 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:28.063+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:28.084 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:28.082+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:28.109 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:28.106+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:28.865 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:28.862+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:28.880 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:28.878+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:29.005 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:29.003+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:29.034 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:29.032+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:29.097 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:29.093+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:29.117 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:29.114+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:29.855 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:29.852+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:29.874 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:29.870+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:30.017 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:30.014+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:30.075 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:30.071+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:30.091 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:30.089+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:30.130 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:30.128+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:30.834 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:30.830+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:30.848 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:30.845+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:30.997 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:30.989+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:31.063 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:31.060+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:31.099 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:31.097+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:31.113 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:31.111+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:31.855 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:31.851+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:31.873 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:31.870+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:32.013 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:32.010+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:32.083 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:32.079+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:32.117 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:32.114+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:32.124 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:32.121+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:32.896 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:32.893+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:32.917 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:32.914+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:32.977 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:32.973+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:33.082 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:33.080+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:33.137 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:33.133+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:33.141 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:33.139+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:33.899 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:33.895+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:33.960 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:33.956+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:33.964 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:33.962+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:34.101 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:34.098+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:34.136 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:34.133+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:34.155 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:34.152+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:34.936 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:34.934+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:34.943 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:34.940+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:35.050 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:34.974+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:35.104 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:35.099+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:35.154 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:35.150+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:35.199 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:35.196+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:35.956 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:35.953+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:35.968 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:35.965+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:35.969 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:35.965+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:36.119 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:36.116+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:36.175 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:36.169+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:36.238 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:36.235+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:18:36.947 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:18:36.945+0000 1694c700 -1 osd.0 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:23.548650+0000 front 2019-11-27T23:17:23.554561+0000 (oldest deadline 2019-11-27T23:18:06.999592+0000) 2019-11-27T23:18:36.998 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:18:36.993+0000 1694c700 -1 osd.5 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.687213+0000 front 2019-11-27T23:17:25.739424+0000 (oldest deadline 2019-11-27T23:18:11.564050+0000) 2019-11-27T23:18:37.011 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:18:37.007+0000 1694c700 -1 osd.6 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:25.325433+0000 front 2019-11-27T23:17:25.380235+0000 (oldest deadline 2019-11-27T23:18:09.969457+0000) 2019-11-27T23:18:37.159 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:18:37.157+0000 1694c700 -1 osd.3 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:21.247532+0000 front 2019-11-27T23:17:21.218479+0000 (oldest deadline 2019-11-27T23:18:06.788464+0000) 2019-11-27T23:18:37.168 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:18:37.164+0000 1694c700 -1 osd.1 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.885113+0000 front 2019-11-27T23:17:22.746773+0000 (oldest deadline 2019-11-27T23:18:06.124060+0000) 2019-11-27T23:18:37.193 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:18:37.190+0000 1694c700 -1 osd.4 188 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:17:22.521426+0000 front 2019-11-27T23:17:22.884992+0000 (oldest deadline 2019-11-27T23:18:07.135375+0000) 2019-11-27T23:19:14.756 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:19:22.231 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:14.762 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:19:22.237 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:14.770 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:19:22.247 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:14.776 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:19:22.249 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:14.781 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:19:22.258 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:14.791 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:19:22.267 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:15.065 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:19:22.540 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:15.140 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:19:22.613 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:15.157 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:19:22.634 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:19:31.280 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:31.279+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:32.276 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:32.275+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:33.248 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:33.247+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:34.265 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:34.263+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:35.233 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:35.232+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:35.397 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:35.395+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:35.714 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:35.711+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:36.203 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:36.202+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:36.381 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:36.377+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:36.696 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:36.694+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:36.892 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:36.890+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:37.158 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:37.158+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:37.400 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:37.397+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:37.519 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:37.516+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:37.676 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:37.673+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:37.938 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:37.937+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:38.118 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:38.118+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:38.414 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:38.411+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:38.477 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:38.474+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:38.686 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:38.684+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:38.701 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:38.697+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:38.917 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:38.916+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:39.119 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:39.119+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:39.448 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:39.446+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:39.460 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:39.457+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:39.673 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:39.670+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:39.678 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:39.675+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:39.922 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:39.920+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:40.087 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:40.083+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:40.090 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:40.090+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:40.435 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:40.433+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:40.486 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:40.483+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:40.639 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:40.636+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:40.718 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:40.716+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:40.946 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:40.945+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:41.096 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:41.094+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:41.100 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:41.099+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:41.436 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:41.431+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:41.491 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:41.488+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:41.647 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:41.643+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:41.675 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:41.673+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:41.994 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:41.992+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:42.148 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:42.146+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:42.151 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:42.150+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:42.460 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:42.457+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:42.478 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:42.475+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:42.681 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:42.677+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:42.688 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:42.688+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:42.915 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:42.912+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124380 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 821263216 gen 32] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-27T23:19:43.043 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:43.041+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:43.150 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:43.147+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:43.151 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:43.149+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:43.442 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:43.439+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:43.470 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:43.467+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:43.644 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:43.643+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:43.728 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:43.725+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:43.943 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:43.941+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:44.011 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:44.010+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:44.150 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:44.149+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:44.153 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:44.152+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:44.410 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:44.407+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:44.524 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:44.521+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:44.663 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:44.661+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:44.718 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:44.716+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:44.959 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:44.957+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:44.993 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:44.992+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:45.159 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:45.156+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:45.160 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:45.158+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:45.417 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:45.413+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:45.570 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:45.569+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:45.647 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:45.645+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:45.740 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:45.738+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:45.924 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:45.919+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:45.983 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:45.982+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:46.162 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:46.160+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:46.163 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:46.162+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:46.457 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:46.454+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:46.546 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:46.544+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:46.668 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:46.667+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:46.729 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:46.726+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:46.888 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:46.886+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:46.952 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:46.950+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:47.185 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:47.183+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:47.188 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:47.188+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:47.423 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:47.412+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:47.504 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:47.501+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:47.703 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:47.702+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:47.760 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:47.758+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:47.920 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:47.918+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:47.982 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:47.978+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:48.233 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:48.231+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:48.236 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:48.234+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:48.432 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:48.428+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:48.467 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:48.465+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:48.672 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:48.669+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:48.719 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:48.716+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:48.948 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:48.946+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:49.007 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:49.005+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:49.203 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:49.199+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:49.204 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:49.201+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:49.416 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:49.414+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:49.432 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:49.430+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:49.662 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:49.659+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:49.714 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:49.711+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:49.960 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:49.957+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:49.961 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:49.958+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:50.043 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:50.034+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:50.217 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:50.214+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:50.217 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:50.215+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:50.440 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:50.438+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:50.471 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:50.468+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:50.698 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:50.696+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:50.700 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:50.698+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:50.965 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:50.963+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:50.966 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:50.964+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:51.078 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:51.075+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:51.224 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:51.218+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:51.232 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:51.221+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:51.394 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:51.393+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:51.452 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:51.452+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:51.659 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:51.657+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:51.693 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:51.690+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:52.016 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:52.014+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:52.018 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:52.015+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:52.098 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:52.095+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:52.272 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:52.269+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:52.273 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:52.271+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:52.403 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:52.396+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:52.485 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:52.484+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:52.669 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:52.667+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:52.722 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:52.720+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:52.980 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:52.977+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:52.980 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:52.979+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:53.057 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:53.054+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:53.248 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:53.246+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:53.250 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:53.248+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:53.386 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:53.385+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:53.450 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:53.449+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:53.648 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:53.645+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:53.738 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:53.736+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:53.994 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:53.991+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:53.997 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:53.995+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:54.054 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:54.050+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:54.212 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:54.210+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:54.213 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:54.212+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:54.347 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:54.343+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:54.496 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:54.490+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:54.621 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:54.618+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:54.722 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:54.720+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:54.968 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:54.965+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:54.968 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:54.966+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:55.033 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:55.030+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:55.218 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:55.216+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:55.220 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:55.219+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:55.338 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:55.335+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:55.498 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:55.494+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:55.627 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:55.624+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:55.775 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:55.772+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:55.986 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:55.984+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:55.986 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:55.985+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:56.078 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:56.075+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:56.245 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:56.242+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:56.247 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:56.245+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:56.374 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:56.371+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:56.507 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:56.504+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:56.600 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:56.596+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:56.757 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:56.753+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:56.998 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:56.995+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:56.999 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:56.997+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:57.113 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:57.111+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:57.276 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:57.273+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:57.281 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:57.278+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:57.368 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:57.365+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:57.544 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:57.540+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:57.554 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:57.552+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:57.736 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:57.733+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:58.004 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:58.001+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:58.004 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:58.002+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:58.107 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:58.098+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:58.266 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:58.264+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:58.274 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:58.272+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:58.351 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:58.347+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:58.531 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:58.526+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:58.559 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:58.556+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:58.709 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:58.706+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:59.013 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:59.010+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:59.014 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:59.011+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:19:59.096 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:19:59.093+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:19:59.279 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:59.276+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:19:59.279 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:19:59.277+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:19:59.383 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:19:59.381+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:19:59.565 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:19:59.562+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:19:59.575 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:19:59.572+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:19:59.714 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:19:59.711+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:19:59.985 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:59.982+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:19:59.986 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:19:59.983+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:00.135 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:00.132+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:00.317 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:00.314+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:00.318 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:00.316+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:00.412 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:00.410+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:00.543 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:00.539+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:00.612 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:00.609+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:00.741 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:00.738+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:00.949 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:00.947+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:00.951 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:00.949+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:01.091 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:01.088+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:01.294 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:01.291+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:01.297 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:01.296+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:01.454 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:01.452+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:01.532 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:01.531+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:01.605 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:01.603+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:01.718 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:01.716+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:01.931 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:01.928+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:01.934 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:01.931+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:02.096 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:02.093+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:02.252 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:02.250+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:02.253 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:02.252+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:02.451 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:02.448+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:02.565 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:02.562+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:02.589 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:02.586+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:02.701 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:02.698+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:02.935 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:02.932+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:02.935 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:02.933+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:03.124 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:03.121+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:03.305 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:03.302+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:03.311 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:03.309+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:03.431 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:03.428+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:03.571 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:03.569+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:03.635 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:03.631+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:03.667 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:03.664+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:03.921 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:03.917+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:03.921 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:03.919+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:04.138 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:04.135+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:04.363 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:04.360+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:04.367 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:04.365+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:04.439 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:04.436+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:04.552 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:04.549+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:04.688 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:04.685+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:04.708 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:04.705+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:04.962 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:04.959+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:04.963 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:04.960+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:05.170 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:05.167+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:05.335 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:05.330+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:05.336 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:05.333+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:05.455 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:05.452+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:05.508 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:05.506+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:05.647 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:05.644+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:05.665 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:05.663+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:05.950 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:05.948+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:05.953 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:05.951+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:06.163 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:06.160+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:06.385 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:06.381+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:06.385 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:06.383+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:06.450 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:06.447+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:06.521 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:06.518+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:06.606 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:06.603+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:06.672 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:06.670+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:06.965 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:06.962+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:06.966 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:06.963+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:07.153 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:07.149+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:07.398 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:07.395+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:07.399 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:07.397+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:07.414 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:07.411+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:07.486 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:07.483+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:07.637 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:07.634+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:07.715 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:07.713+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:07.719 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:20:07.712+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 44sec e195 v195) 2019-11-27T23:20:07.963 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:07.960+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:07.964 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:07.962+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:08.183 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:08.181+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:08.391 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:08.374+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:08.428 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:08.425+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:08.432 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:08.430+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:08.485 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:08.482+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:08.652 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:08.649+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:08.756 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:08.754+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:09.016 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:09.013+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:09.017 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:09.015+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:09.210 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:09.208+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:09.387 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:09.385+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:09.392 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:09.390+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:09.393 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:09.391+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:09.454 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:09.451+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:09.678 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:09.676+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:09.721 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:09.718+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:10.029 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:10.026+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:10.029 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:10.027+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:10.167 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:10.164+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:10.379 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:10.377+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:10.387 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:10.384+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:10.388 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:10.386+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:10.436 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:10.434+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:10.665 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:10.662+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:10.695 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:10.692+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:11.051 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:11.047+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:11.051 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:11.049+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:11.203 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:11.201+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:11.403 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:11.399+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:11.418 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:11.415+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:11.424 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:11.421+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:11.427 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:11.425+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:11.671 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:11.669+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:11.707 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:11.705+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:12.040 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:12.037+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:12.043 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:12.041+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:12.222 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:12.220+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:12.405 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:12.401+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:12.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:12.404+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:12.419 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:12.417+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:12.453 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:12.450+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:12.677 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:12.673+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:12.692 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:12.689+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:12.727 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:20:12.725+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 44sec e195 v195) 2019-11-27T23:20:13.062 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:13.059+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:13.065 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:13.063+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:13.187 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:13.184+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:13.390 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:13.387+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:13.391 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:13.389+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:13.407 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:13.403+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:13.425 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:13.422+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:13.650 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:13.648+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:13.660 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:13.657+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:14.072 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:14.069+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:14.072 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:14.071+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:14.147 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:14.144+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:14.374 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:14.370+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:14.375 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:14.372+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:14.394 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:14.392+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:14.441 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:14.438+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:14.660 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:14.657+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:14.693 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:14.691+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:15.125 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:15.122+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:15.127 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:15.126+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:15.159 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:15.156+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:15.401 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:15.397+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:15.402 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:15.399+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:15.431 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:15.430+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:15.442 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:15.440+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:15.664 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:15.663+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:15.677 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:15.674+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:16.161 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:16.158+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:16.162 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:16.160+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:16.195 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:16.193+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:16.371 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:16.367+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:16.372 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:16.370+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:16.408 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:16.406+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:16.468 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:16.466+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:16.641 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:16.638+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:16.696 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:16.693+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:17.124 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:17.121+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:17.125 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:17.123+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:17.169 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:17.167+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:17.364 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:17.361+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:17.419 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:17.418+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:17.421 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:17.421+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:17.512 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:17.510+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:17.676 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:17.673+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:17.719 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:17.717+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:17.749 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:20:17.747+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 44sec e195 v195) 2019-11-27T23:20:18.097 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:18.092+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:18.097 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:18.094+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:18.193 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:18.191+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:18.353 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:18.350+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:18.461 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:18.457+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:18.463 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:18.460+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:18.553 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:18.551+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:18.663 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:18.661+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:18.679 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:18.677+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:19.095 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:19.093+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:19.096 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:19.094+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:19.171 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:19.169+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:19.346 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:19.343+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:19.492 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:19.490+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:19.494 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:19.492+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:19.601 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:19.598+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:19.633 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:19.631+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:19.670 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:19.668+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:20.144 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:20.140+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:20.144 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:20.142+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:20.175 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:20.173+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:20.387 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:20.384+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:20.529 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:20.526+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:20.530 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:20.528+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:20.634 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:20.631+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:20.642 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:20.639+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:20.648 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:20.646+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:21.106 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:21.103+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:21.109 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:21.107+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:21.177 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:21.176+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:21.365 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:21.362+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:21.489 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:21.485+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:21.490 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:21.488+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:21.625 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:21.623+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:21.652 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:21.649+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:21.677 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:21.674+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:22.091 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:22.088+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:22.092 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:22.090+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:22.183 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:22.181+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:22.407 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:22.405+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:22.491 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:22.490+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:22.493 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:22.493+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:22.591 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:22.590+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:22.619 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:22.616+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:22.638 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:22.636+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:22.761 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:20:22.759+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 44sec e195 v195) 2019-11-27T23:20:23.139 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:23.131+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:23.141 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:23.135+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:23.241 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:23.236+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:23.370 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:23.363+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:23.472 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:23.469+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:23.474 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:23.472+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:23.597 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:23.594+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:23.609 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:23.607+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:23.612 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:23.609+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:24.155 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:24.152+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:24.155 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:24.153+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:24.242 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:24.241+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:24.370 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:24.367+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:24.444 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:24.442+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:24.445 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:24.443+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:24.565 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:24.564+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:24.584 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:24.582+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:24.625 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:24.623+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:25.205 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:25.202+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:25.206 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:25.203+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:25.214 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:25.212+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:25.384 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:25.382+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:25.494 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:25.489+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:25.495 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:25.492+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:25.525 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:25.523+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:25.578 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:25.576+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:25.641 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:25.639+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:26.189 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:26.187+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:26.247 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:26.244+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:26.248 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:26.245+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:26.374 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:26.372+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:26.499 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:26.495+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:26.500 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:26.498+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:26.538 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:26.535+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:26.540 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:26.537+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:26.665 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:26.663+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:27.173 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:20:27.172+0000 1694c700 -1 osd.7 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.644544+0000 front 2019-11-27T23:18:55.643085+0000 (oldest deadline 2019-11-27T23:19:36.876081+0000) 2019-11-27T23:20:27.255 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:27.253+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:27.256 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:27.253+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:27.341 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:27.335+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:27.533 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:20:27.530+0000 1694c700 -1 osd.3 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.187715+0000 front 2019-11-27T23:18:54.323278+0000 (oldest deadline 2019-11-27T23:19:36.681298+0000) 2019-11-27T23:20:27.543 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:20:27.541+0000 1694c700 -1 osd.0 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:51.761669+0000 front 2019-11-27T23:18:55.306693+0000 (oldest deadline 2019-11-27T23:19:34.428292+0000) 2019-11-27T23:20:27.547 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:27.544+0000 1694c700 -1 osd.4 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:55.384345+0000 front 2019-11-27T23:18:55.383317+0000 (oldest deadline 2019-11-27T23:19:39.145598+0000) 2019-11-27T23:20:27.549 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:27.547+0000 1694c700 -1 osd.4 195 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:27.646 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:20:27.645+0000 1694c700 -1 osd.6 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.109738+0000 front 2019-11-27T23:18:54.073877+0000 (oldest deadline 2019-11-27T23:19:37.956484+0000) 2019-11-27T23:20:27.839 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:20:27.833+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 44sec e195 v195) 2019-11-27T23:20:28.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:28.258+0000 1694c700 -1 osd.2 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:19:09.344838+0000 (oldest deadline 2019-11-27T23:19:49.344838+0000) 2019-11-27T23:20:28.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:20:28.258+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e192) 2019-11-27T23:20:28.335 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:20:28.334+0000 1694c700 -1 osd.1 195 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:18:54.441379+0000 front 2019-11-27T23:18:53.462253+0000 (oldest deadline 2019-11-27T23:19:35.612309+0000) 2019-11-27T23:20:28.516 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:28.513+0000 1694c700 -1 osd.4 196 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:29.663 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:29.645+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:30.691 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:30.689+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:31.698 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:31.696+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:32.713 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:32.711+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:33.755 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:33.754+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:34.762 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:34.757+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:35.799 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:35.797+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:36.814 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:36.812+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:37.867 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:37.865+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:38.855 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:38.852+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:39.894 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:39.892+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:40.885 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:40.883+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:41.878 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:41.876+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:42.854 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:42.853+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:43.888 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:43.887+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:44.926 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:44.924+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:45.968 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:45.966+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:46.955 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:46.953+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:47.947 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:47.946+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:48.944 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:48.937+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:49.945 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:49.943+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:50.970 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:50.968+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:51.998 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:51.996+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:53.043 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:53.041+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:54.085 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:54.084+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:55.041 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:55.039+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:56.034 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:20:56.032+0000 1694c700 -1 osd.4 197 get_health_metrics reporting 17 slow ops, oldest is osd_op(client.4537.0:124342 5.e 5:7759931f:::notify.3:head [watch ping cookie 822858672 gen 1] snapc 0=[] ondisk+write+known_if_redirected e190) 2019-11-27T23:20:57.116 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:20:57.114+0000 20e22700 -1 RGWWatcher::handle_error cookie 822858672 err (107) Transport endpoint is not connected 2019-11-27T23:20:59.051 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:20:59.007+0000 34789700 -1 osd.5 195 build_incremental_map_msg missing incremental map 192 2019-11-27T23:21:04.973 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:21:04.938+0000 31f84700 -1 osd.5 200 build_incremental_map_msg missing incremental map 200 2019-11-27T23:21:05.006 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:21:04.991+0000 3778f700 -1 osd.5 200 build_incremental_map_msg missing incremental map 200 2019-11-27T23:21:05.177 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:21:05.084+0000 33f88700 -1 osd.5 200 build_incremental_map_msg missing incremental map 200 2019-11-27T23:21:05.928 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:21:05.912+0000 31f84700 -1 osd.5 200 build_incremental_map_msg missing incremental map 200 2019-11-27T23:21:34.263 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:21:34.251+0000 1694c700 -1 osd.5 200 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:124671 5.f 5:f95f44c2:::notify.0:head [watch reconnect cookie 820964128 gen 58] snapc 0=[] ondisk+write+known_if_redirected e199) 2019-11-27T23:22:03.011 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:03.007+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:03.836 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:03.833+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:04.062 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:04.058+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:04.808 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:04.805+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:04.999 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:04.997+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:05.046 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:05.043+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:05.162 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:05.158+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:05.805 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:05.802+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:06.007 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:06.003+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:06.100 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:06.096+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:06.130 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:06.128+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:06.233 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:06.230+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:06.770 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:06.768+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:07.035 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:07.032+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:07.093 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:07.088+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:07.171 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:07.168+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:07.278 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:07.266+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:07.820 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:07.817+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:08.050 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:08.046+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:08.096 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:08.093+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:08.099 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:08.097+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:08.193 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:08.184+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:08.312 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:08.307+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:08.510 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:08.507+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:08.868 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:08.867+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:09.015 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:09.012+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:09.080 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:09.075+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:09.135 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:09.131+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:09.178 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:09.174+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:09.311 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:09.309+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:09.561 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:09.558+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:09.827 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:09.825+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:09.983 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:09.979+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:10.059 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:10.057+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:10.187 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:10.184+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:10.217 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:10.215+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:10.287 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:10.284+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:10.537 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:10.536+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:10.860 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:10.857+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:10.956 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:10.951+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:11.088 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:11.083+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:11.189 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:11.186+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:11.192 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:11.189+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:11.344 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:11.341+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:11.541 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:11.537+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:11.863 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:11.860+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:11.922 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:11.918+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:12.092 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:12.089+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:12.180 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:12.177+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:12.232 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:12.229+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:12.350 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:12.347+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:12.576 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:12.574+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:12.839 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:12.836+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:12.974 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:12.970+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:13.101 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:13.093+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:13.158 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:13.155+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:13.239 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:13.235+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:13.374 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:13.372+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:13.582 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:13.574+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:13.812 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:13.808+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:14.009 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:14.006+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:14.119 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:14.116+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:14.180 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:14.177+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:14.287 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:14.265+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:14.383 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:14.374+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:14.591 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:14.590+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:14.768 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:14.766+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:14.961 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:14.959+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:15.170 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:15.165+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:15.184 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:15.181+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:15.308 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:15.305+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:15.423 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:15.418+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:15.605 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:15.603+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:15.728 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:15.725+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:15.927 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:15.924+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:16.171 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:16.169+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:16.221 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:16.218+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:16.312 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:16.310+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:16.401 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:16.398+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:16.655 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:16.652+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:16.764 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:16.761+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:16.965 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:16.962+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:17.181 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:17.178+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:17.221 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:17.219+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:17.332 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:17.329+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:17.382 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:17.381+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:17.700 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:17.696+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:17.808 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:17.806+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:17.958 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:17.955+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:18.156 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:18.153+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:18.233 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:18.230+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:18.333 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:18.331+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:18.431 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:18.429+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:18.676 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:18.673+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:18.807 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:18.804+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:18.924 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:18.922+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:19.154 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:19.150+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:19.254 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:19.250+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:19.368 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:19.366+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:19.411 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:19.409+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:19.677 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:19.674+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:19.846 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:19.844+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:19.896 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:19.894+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:20.139 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:20.135+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:20.269 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:20.263+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:20.390 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:20.387+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:20.437 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:20.435+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:20.730 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:20.728+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:20.870 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:20.868+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:20.913 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:20.910+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:21.137 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:21.134+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:21.309 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:21.308+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:21.359 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:21.357+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:21.419 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:21.417+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:21.757 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:21.753+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:21.903 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:21.899+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:21.936 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:21.932+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:22.193 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:22.187+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:22.341 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:22.336+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:22.349 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:22.348+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:22.456 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:22.452+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:22.746 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:22.742+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:22.917 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:22.914+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:22.932 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:22.928+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:23.199 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:23.195+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:23.304 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:23.302+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:23.376 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:23.373+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:23.462 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:23.458+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:23.747 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:23.744+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:23.920 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:23.918+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:23.958 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:23.956+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:24.249 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:24.246+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:24.342 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:24.340+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:24.382 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:24.379+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:24.505 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:24.502+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:24.744 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:24.740+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:24.951 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:24.947+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:25.013 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:25.010+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:25.268 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:25.265+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:25.322 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:25.320+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:25.339 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:25.336+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:25.477 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:25.474+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:25.724 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:25.722+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:25.965 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:25.962+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:26.021 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:26.017+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:26.236 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:26.234+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:26.325 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:26.322+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:26.351 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:26.344+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:26.442 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:26.439+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:26.750 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:26.747+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:26.952 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:26.949+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:27.017 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:27.014+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:27.211 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:27.208+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:27.281 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:27.278+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:27.397 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:27.394+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:27.429 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:27.426+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:27.777 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:27.774+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:27.935 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:27.932+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:28.050 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:28.047+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:28.203 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:28.199+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:28.302 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:28.299+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:28.412 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:28.408+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:28.426 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:28.423+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:28.776 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:28.773+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:28.928 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:28.924+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:29.070 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:29.067+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:29.173 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:29.170+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:29.280 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:29.276+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:29.417 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:29.414+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:29.427 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:29.425+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:29.753 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:29.748+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:29.897 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:29.894+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:30.123 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:30.120+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:30.185 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:30.183+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:30.236 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:30.234+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:30.429 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:30.425+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:30.446 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:30.443+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:30.745 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:30.742+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:30.902 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:30.898+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:31.126 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:31.122+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:31.226 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:31.222+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:31.261 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:31.252+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:31.394 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:31.391+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:31.431 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:31.428+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:31.770 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:31.766+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:31.943 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:31.941+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:32.091 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:32.087+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:32.213 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:32.210+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:32.254 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:32.251+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:32.370 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:32.367+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:32.448 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:32.445+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:32.752 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:32.748+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:32.922 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:32.919+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:33.128 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:33.124+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:33.168 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:33.164+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:33.219 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:33.214+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:33.403 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:33.401+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:33.407 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:33.403+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:33.803 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:33.795+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:33.936 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:33.934+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:34.145 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:34.142+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:34.165 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:34.162+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:34.234 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:34.231+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:34.360 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:34.357+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:34.453 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:34.446+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:34.801 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:34.797+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:34.983 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:34.980+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:35.144 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:35.141+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:35.219 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:35.216+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:35.259 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:35.255+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:35.382 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:35.378+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:35.485 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:35.480+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:35.769 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:35.765+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:36.028 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:36.025+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:36.170 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:36.167+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:36.232 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:36.225+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:36.300 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:36.295+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:36.362 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:36.359+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:36.467 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:36.463+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:36.759 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:36.756+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:37.042 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:37.037+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:37.152 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:37.146+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:37.257 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:37.254+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:37.268 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:37.266+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:37.318 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:37.316+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:37.457 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:37.452+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:37.801 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:22:37.796+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:23.006972+0000 front 2019-11-27T23:21:22.976138+0000 (oldest deadline 2019-11-27T23:22:08.326561+0000) 2019-11-27T23:22:38.048 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:22:38.045+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.846957+0000 front 2019-11-27T23:21:21.958990+0000 (oldest deadline 2019-11-27T23:22:04.111373+0000) 2019-11-27T23:22:38.145 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:22:38.142+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:18.847593+0000 front 2019-11-27T23:21:18.851421+0000 (oldest deadline 2019-11-27T23:22:04.721038+0000) 2019-11-27T23:22:38.286 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:22:38.282+0000 1694c700 -1 osd.0 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.877712+0000 front 2019-11-27T23:21:22.400983+0000 (oldest deadline 2019-11-27T23:22:07.697249+0000) 2019-11-27T23:22:38.287 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:38.284+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:38.349 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:22:38.346+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:22.340577+0000 front 2019-11-27T23:21:22.850870+0000 (oldest deadline 2019-11-27T23:22:02.805187+0000) 2019-11-27T23:22:38.359 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:22:38.353+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.156:6810/10487,v1:172.21.15.156:6811/10487] for 45sec e200 v200) 2019-11-27T23:22:38.458 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:22:38.456+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.508758+0000 front 2019-11-27T23:21:21.536971+0000 (oldest deadline 2019-11-27T23:22:06.182270+0000) 2019-11-27T23:22:39.251 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:22:39.247+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:21:21.212977+0000 front 2019-11-27T23:21:21.505596+0000 (oldest deadline 2019-11-27T23:22:03.296212+0000) 2019-11-27T23:22:58.568 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:06.044 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.572 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:06.048 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.613 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:06.089 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.614 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:06.091 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.622 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:06.099 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.628 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:06.104 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.810 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:06.286 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.813 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:06.289 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:22:58.864 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:06.339 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.020 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:15.495 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.028 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:15.504 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.039 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:15.516 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.041 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:15.518 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.043 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:15.520 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.046 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:15.521 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.072 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:23:15.549 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.079 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:23:15.556 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:08.102 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:23:15.577 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:23:09.226 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:09.224+0000 114ab700 -1 osd.6 205 build_incremental_map_msg missing incremental map 204 2019-11-27T23:23:09.231 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:09.228+0000 11cac700 -1 osd.7 205 build_incremental_map_msg missing incremental map 204 2019-11-27T23:23:33.664 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:33.663+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:34.655 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:34.652+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:35.677 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:35.676+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:36.434 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:36.430+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:36.687 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:36.685+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:37.140 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:37.137+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:37.423 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:37.420+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:37.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:37.716+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:37.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:37.718+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:38.123 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:38.120+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:38.467 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:38.464+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:38.510 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:38.508+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:38.691 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:38.687+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:38.691 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:38.689+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:39.111 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:39.109+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:39.356 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:39.353+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:39.512 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:39.510+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:39.520 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:39.518+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:39.708 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:39.704+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:39.708 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:39.706+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:40.156 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:40.154+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:40.403 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:40.400+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:40.434 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:40.430+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:40.546 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:40.544+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:40.564 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:40.562+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:40.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:40.716+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:40.720 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:40.718+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:41.179 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:41.177+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:41.375 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:41.372+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:41.424 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:41.421+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:41.553 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:41.551+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:41.573 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:41.570+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:41.708 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:41.703+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:41.712 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:41.709+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:42.212 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:42.209+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:42.362 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:42.360+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:42.377 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:42.375+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:42.390 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:42.387+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:42.532 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:42.530+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:42.559 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:42.556+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:42.709 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:42.707+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:42.711 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:42.710+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:43.176 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:43.173+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:43.372 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:43.369+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:43.408 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:43.405+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:43.415 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:43.413+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:43.493 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:43.490+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:43.558 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:43.554+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:43.669 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:43.665+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:43.669 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:43.667+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:44.138 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:44.135+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:44.364 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:44.359+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:44.373 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:44.370+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:44.449 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:44.447+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:44.488 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:44.485+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:44.538 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:44.536+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:44.667 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:44.665+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:44.668 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:44.667+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:45.123 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:45.120+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:45.332 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:45.328+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:45.333 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:45.329+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:45.408 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:45.405+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:45.424 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:45.423+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:45.486 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:45.484+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:45.516 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:45.513+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:45.681 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:45.675+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:45.681 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:45.677+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:46.147 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:46.140+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:46.305 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:46.302+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:46.309 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:46.304+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:46.408 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:46.406+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:46.415 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:46.412+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:46.498 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:46.495+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:46.517 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:46.514+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:46.707 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:46.705+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:46.709 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:46.707+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:47.140 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:47.137+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:47.269 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:47.266+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:47.272 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:47.270+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:47.376 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:47.372+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:47.378 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:47.376+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:47.529 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:47.526+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:47.570 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:47.566+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:47.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:47.698+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:47.705 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:47.702+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:48.161 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:48.158+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:48.249 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:48.245+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:48.249 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:48.247+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:48.345 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:48.342+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:48.377 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:48.374+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:48.559 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:48.556+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:48.564 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:48.562+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:48.662 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:48.657+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:48.663 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:48.660+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:49.119 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:49.116+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:49.276 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:49.273+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:49.278 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:49.276+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:49.390 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:49.387+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:49.395 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:49.385+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:49.547 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:49.545+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:49.559 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:49.557+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:49.621 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:49.619+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:49.621 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:49.620+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:50.078 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:50.074+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:50.267 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:50.263+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:50.269 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:50.264+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:50.392 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:50.390+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:50.440 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:50.437+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:50.516 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:50.514+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:50.534 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:50.532+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:50.646 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:50.641+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:50.649 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:50.644+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:51.051 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:51.046+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:51.257 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:51.255+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:51.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:51.258+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:51.354 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:51.351+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:51.438 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:51.436+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:51.486 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:51.483+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:51.583 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:51.580+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:51.672 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:51.668+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:51.673 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:51.670+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:52.070 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:52.066+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:52.243 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:52.239+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:52.244 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:52.241+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:52.358 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:52.355+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:52.434 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:52.431+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:52.525 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:52.521+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:52.560 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:52.557+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:52.670 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:52.667+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:52.673 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:52.671+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:53.078 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:53.075+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:53.204 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:53.200+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:53.204 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:53.202+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:53.321 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:53.319+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:53.476 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:53.473+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:53.501 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:53.497+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:53.601 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:53.598+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:53.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:53.716+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:53.720 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:53.718+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:54.058 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:54.055+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:54.257 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:54.254+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:54.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:54.258+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:54.311 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:54.307+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:54.454 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:54.451+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:54.508 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:54.497+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:54.617 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:54.616+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:54.774 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:54.770+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:54.775 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:54.773+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:55.088 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:55.084+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:55.284 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:55.281+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:55.298 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:55.295+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:55.300 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:55.296+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:55.460 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:55.457+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:55.509 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:55.506+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:55.588 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:55.585+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:55.756 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:55.751+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:55.756 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:55.754+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:56.051 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:56.047+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:56.291 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:56.289+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:56.302 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:56.299+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:56.305 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:56.303+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:56.459 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:56.456+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:56.538 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:56.535+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:56.631 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:56.628+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:56.786 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:56.783+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:56.790 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:56.788+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:57.035 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:57.033+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:57.297 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:57.294+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:57.297 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:57.295+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:57.320 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:57.318+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:57.486 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:57.482+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:57.556 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:57.554+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:57.666 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:57.663+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:57.815 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:57.810+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:57.816 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:57.813+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:57.989 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:57.986+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:58.307 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:58.304+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:58.308 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:58.305+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:58.319 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:58.317+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:58.473 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:58.471+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:58.524 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:58.520+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:58.654 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:58.652+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:58.794 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:58.790+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:58.795 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:58.792+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:23:59.003 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:23:59.001+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:23:59.265 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:59.263+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:23:59.265 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:23:59.263+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:23:59.353 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:23:59.351+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:23:59.463 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:23:59.461+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:23:59.529 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:23:59.523+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:23:59.622 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:23:59.620+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:23:59.834 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:59.831+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:23:59.835 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:23:59.832+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:00.043 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:00.039+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:00.242 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:00.240+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:00.243 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:00.242+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:00.398 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:00.396+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:00.496 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:00.493+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:00.566 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:00.564+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:00.624 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:00.621+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:00.801 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:00.796+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:00.805 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:00.802+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:01.054 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:01.052+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:01.292 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:01.288+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:01.293 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:01.290+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:01.380 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:01.377+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:01.545 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:01.543+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:01.593 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:01.590+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:01.606 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:01.604+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:01.800 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:01.797+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:01.806 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:01.803+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:02.043 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:02.040+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:02.345 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:02.342+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:02.345 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:02.342+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:02.346 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:02.344+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:02.533 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:02.530+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:02.616 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:02.613+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:02.643 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:02.639+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:02.765 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:02.762+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:02.768 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:02.766+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:03.049 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:03.045+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:03.302 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:03.299+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:03.305 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:03.303+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:03.353 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:03.351+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:03.527 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:03.525+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:03.641 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:03.639+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:03.661 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:03.658+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:03.744 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:03.741+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:03.745 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:03.743+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:04.018 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:04.015+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:04.296 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:04.293+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:04.297 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:04.295+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:04.337 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:04.333+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:04.515 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:04.513+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:04.623 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:04.620+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:04.644 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:04.641+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:04.766 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:04.762+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:04.767 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:04.764+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:04.993 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:04.984+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:05.254 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:05.252+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:05.264 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:05.253+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:05.379 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:05.376+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:05.470 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:05.468+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:05.608 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:05.606+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:05.620 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:05.618+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:05.771 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:05.766+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:05.772 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:05.769+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:05.954 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:05.952+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:06.245 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:06.242+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:06.245 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:06.243+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:06.338 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:06.337+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:06.464 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:06.461+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:06.622 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:06.619+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:06.656 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:06.647+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:06.727 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:06.725+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:06.728 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:06.727+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:06.908 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:06.905+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:07.284 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:07.281+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:07.285 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:07.283+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:07.387 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:07.386+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:07.505 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:07.502+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:07.580 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:07.577+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:07.622 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:07.621+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:07.723 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:07.720+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:07.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:07.723+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:07.888 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:07.884+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:08.322 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:08.318+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:08.322 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:08.320+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:08.356 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:08.354+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:08.550 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:08.547+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:08.597 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:08.593+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:08.633 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:08.631+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:08.761 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:08.753+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:08.762 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:08.755+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:08.815 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:24:08.809+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e207 v207) 2019-11-27T23:24:08.896 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:08.893+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:09.276 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:09.273+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:09.276 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:09.274+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:09.348 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:09.347+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:09.508 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:09.504+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:09.618 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:09.615+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:09.680 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:09.678+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:09.784 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:09.782+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:09.785 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:09.784+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:09.898 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:09.895+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:10.316 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:10.314+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:10.317 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:10.316+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:10.336 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:10.335+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:10.540 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:10.537+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:10.624 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:10.621+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:10.653 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:10.651+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:10.767 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:10.764+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:10.768 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:10.767+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:10.934 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:10.930+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:11.279 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:11.275+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:11.279 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:11.277+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:11.317 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:11.315+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:11.579 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:11.576+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:11.658 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:11.656+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:11.690 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:11.688+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:11.776 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:11.773+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:11.777 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:11.776+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:11.904 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:11.900+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:12.254 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:12.251+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:12.254 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:12.252+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:12.271 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:12.269+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:12.612 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:12.610+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:12.618 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:12.615+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:12.683 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:12.682+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:12.801 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:12.797+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:12.802 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:12.800+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:12.895 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:12.891+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:13.226 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:13.225+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:13.238 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:13.233+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:13.240 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:13.237+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:13.580 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:13.577+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:13.619 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:13.617+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:13.646 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:13.644+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:13.761 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:13.758+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:13.762 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:13.760+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:13.836 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:24:13.833+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e207 v207) 2019-11-27T23:24:13.934 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:13.931+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:14.211 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:14.210+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:14.246 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:14.243+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:14.249 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:14.247+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:14.583 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:14.581+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:14.616 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:14.613+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:14.643 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:14.641+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:14.659 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:14.654+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:14.758 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:14.754+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:14.764 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:14.757+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:14.890 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:14.887+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:15.213 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:15.211+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:15.227 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:15.216+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:15.227 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:15.218+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:15.565 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:15.563+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:15.599 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:15.596+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:15.707 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:15.704+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:15.707 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:15.706+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:15.720 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:15.717+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:15.723 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:15.719+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:15.881 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:15.877+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:16.195 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:16.193+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:16.265 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:16.261+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:16.265 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:16.263+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:16.524 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:16.521+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:16.563 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:16.560+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:16.758 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:16.754+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:16.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:16.756+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:16.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:16.757+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:16.760 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:16.757+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:16.891 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:16.888+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:17.191 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:17.188+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:17.224 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:17.220+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:17.225 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:17.222+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:17.523 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:17.519+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:17.599 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:17.596+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:17.715 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:17.710+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:17.731 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:17.726+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:17.806 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:17.802+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:17.809 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:17.805+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:17.873 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:17.870+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:18.203 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:18.201+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:18.241 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:18.239+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:18.243 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:18.242+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:18.516 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:18.513+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:18.645 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:18.636+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:18.731 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:18.729+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:18.732 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:18.730+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:18.845 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:24:18.843+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e207 v207) 2019-11-27T23:24:18.854 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:18.851+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:18.855 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:18.853+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:18.895 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:18.893+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:19.202 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:19.198+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:19.263 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:19.259+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:19.264 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:19.261+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:19.495 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:19.492+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:19.682 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:19.678+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:19.727 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:19.725+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:19.728 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:19.727+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:19.876 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:19.872+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:19.878 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:19.876+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:19.948 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:19.944+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:20.211 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:20.208+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:20.242 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:20.236+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:20.242 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:20.239+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:20.513 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:20.511+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:20.658 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:20.655+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:20.769 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:20.768+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:20.772 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:20.771+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:20.858 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:20.856+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:20.863 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:20.861+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:20.971 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:20.967+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:21.179 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:21.178+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:21.208 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:21.203+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:21.208 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:21.205+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:21.546 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:21.544+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:21.665 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:21.663+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:21.817 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:21.816+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:21.818 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:21.817+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:21.850 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:21.847+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:21.851 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:21.850+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:21.991 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:21.988+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:22.212 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:22.210+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:22.255 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:22.251+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:22.256 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:22.253+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:22.520 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:22.517+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:22.619 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:22.616+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:22.791 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:22.790+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:22.792 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:22.791+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:22.837 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:22.835+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:22.838 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:22.836+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:23.020 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:23.016+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:23.193 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:23.190+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:23.234 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:23.230+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:23:04.636887+0000 (oldest deadline 2019-11-27T23:23:44.636887+0000) 2019-11-27T23:24:23.234 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:23.232+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:23.515 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:24:23.511+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.932054+0000 front 2019-11-27T23:22:54.931234+0000 (oldest deadline 2019-11-27T23:23:40.022743+0000) 2019-11-27T23:24:23.594 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:23.591+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:23.831 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:23.829+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.315626+0000 front 2019-11-27T23:22:54.317196+0000 (oldest deadline 2019-11-27T23:23:37.964830+0000) 2019-11-27T23:24:23.831 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:23.830+0000 1694c700 -1 osd.6 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:23.865 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:23.863+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.931776+0000 front 2019-11-27T23:22:54.884390+0000 (oldest deadline 2019-11-27T23:23:36.842602+0000) 2019-11-27T23:24:23.866 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:23.864+0000 1694c700 -1 osd.4 207 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:23.910 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:24:23.909+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e207 v207) 2019-11-27T23:24:24.025 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:24:24.021+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:54.290932+0000 front 2019-11-27T23:22:54.820769+0000 (oldest deadline 2019-11-27T23:23:36.929944+0000) 2019-11-27T23:24:24.230 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:24:24.228+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:55.405131+0000 front 2019-11-27T23:22:55.600515+0000 (oldest deadline 2019-11-27T23:23:38.982607+0000) 2019-11-27T23:24:24.411 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:24:24.388+0000 1694c700 -1 osd.2 208 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e205) 2019-11-27T23:24:24.553 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:24:24.550+0000 1694c700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:22:50.372846+0000 front 2019-11-27T23:22:51.923693+0000 (oldest deadline 2019-11-27T23:23:36.119765+0000) 2019-11-27T23:24:24.860 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:24.860+0000 1694c700 -1 osd.4 208 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:24.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:24.865+0000 1694c700 -1 osd.6 208 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:25.902 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:25.886+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:25.908 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:25.907+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:26.849 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:26.847+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:26.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:26.883+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:27.848 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:27.846+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:27.849 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:27.847+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:28.847 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:28.846+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:28.859 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:28.857+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:29.808 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:29.806+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:29.883 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:29.881+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:30.838 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:30.837+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:30.856 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:30.855+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:31.830 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:31.829+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:31.853 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:31.852+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:32.788 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:32.787+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:32.885 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:32.884+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:33.797 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:33.790+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:33.880 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:33.878+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:34.268 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:24:41.744 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.303 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:24:41.779 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.358 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:24:41.834 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.359 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:24:41.836 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.364 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:24:41.840 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.370 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:24:41.846 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.467 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:24:41.943 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.517 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:24:41.986 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.544 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:24:42.021 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:24:34.823 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:34.823+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:34.850 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:34.847+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:35.841 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:35.839+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:35.870 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:35.869+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:36.844 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:36.841+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:36.918 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:36.917+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:37.895 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:37.893+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:37.897 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:37.896+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:38.860 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:38.859+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:38.907 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:38.905+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:39.903 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:39.901+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:39.907 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:39.906+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:40.900 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:40.898+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:40.930 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:40.929+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:41.869 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:41.868+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:41.948 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:41.948+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:42.853 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:42.851+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:42.996 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:42.995+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:43.813 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:43.811+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:44.039 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:44.038+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:44.842 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:44.840+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:45.026 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:45.025+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:45.885 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:45.883+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:46.063 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:46.062+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:46.863 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:46.860+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:47.018 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:47.016+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:47.905 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:47.903+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:48.048 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:48.047+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:48.932 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:48.930+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:49.007 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:49.007+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:49.914 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:49.911+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:50.003 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:50.002+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:50.880 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:50.878+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:51.057 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:51.055+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:51.860 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:51.859+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:52.021 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:52.020+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:52.900 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:52.898+0000 1694c700 -1 osd.4 209 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125082 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e202) 2019-11-27T23:24:53.029 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:24:53.027+0000 1694c700 -1 osd.6 209 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125200 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [create,call rgw.bucket_init_index in=20b] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:53.921 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:24:53.883+0000 1694c700 -1 osd.4 210 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125137 5.e 5:7759931f:::notify.3:head [watch ping cookie 385443424 gen 1] snapc 0=[] ondisk+write+known_if_redirected e207) 2019-11-27T23:24:54.506 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:24:54.500+0000 20e22700 -1 RGWWatcher::handle_error cookie 385443424 err (107) Transport endpoint is not connected 2019-11-27T23:25:00.945 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:00.929+0000 3578b700 -1 osd.5 212 build_incremental_map_msg missing incremental map 212 2019-11-27T23:25:02.661 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:02.623+0000 34789700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:02.698 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:02.694+0000 3778f700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:02.724 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:02.704+0000 31f84700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:02.961 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:02.852+0000 3678d700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:03.110 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:02.883+0000 33787700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:03.345 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:03.001+0000 34f8a700 -1 osd.5 213 build_incremental_map_msg missing incremental map 212 2019-11-27T23:25:03.353 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:03.046+0000 34f8a700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:25:03.364 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:03.103+0000 38f92700 -1 osd.5 213 build_incremental_map_msg missing incremental map 212 2019-11-27T23:25:03.395 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:25:03.192+0000 38f92700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-27T23:26:01.920 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:01.917+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:02.741 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:02.737+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:02.911 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:02.906+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:02.927 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:02.922+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:03.246 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:03.245+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:03.793 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:03.789+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:03.885 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:03.881+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:03.942 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:03.939+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:04.162 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:04.159+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:04.178 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:04.157+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:04.293 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:04.291+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:04.769 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:04.765+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:04.867 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:04.864+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:04.921 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:04.918+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:05.138 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:05.136+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:05.193 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:05.190+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:05.205 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:05.202+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:05.257 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:05.255+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:05.737 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:05.734+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:05.889 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:05.885+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:05.899 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:05.897+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:06.189 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:06.186+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:06.232 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:06.229+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:06.261 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:06.259+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:06.276 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:06.273+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:06.792 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:06.787+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:06.846 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:06.842+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:06.911 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:06.908+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:07.186 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:07.184+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:07.220 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:07.217+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:07.221 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:07.219+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:07.322 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:07.316+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:07.748 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:07.744+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:07.810 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:07.804+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:07.936 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:07.933+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:08.151 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:08.149+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:08.181 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:08.178+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:08.218 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:08.215+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:08.293 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:08.291+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:08.793 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:08.790+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:08.820 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:08.817+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:08.912 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:08.909+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:09.174 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:09.172+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:09.180 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:09.177+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:09.181 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:09.180+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:09.381 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:09.359+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:09.833 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:09.829+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:09.837 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:09.834+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:09.903 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:09.900+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:10.135 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:10.132+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:10.184 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:10.182+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:10.236 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:10.231+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:10.335 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:10.331+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:10.846 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:10.842+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:10.883 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:10.880+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:10.891 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:10.885+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:11.165 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:11.162+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:11.188 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:11.186+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:11.256 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:11.253+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:11.331 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:11.327+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:11.866 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:11.864+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:11.871 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:11.865+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:11.933 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:11.931+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:12.165 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:12.161+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:12.177 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:12.175+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:12.288 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:12.284+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:12.362 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:12.358+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:12.825 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:12.821+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:12.849 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:12.845+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:12.969 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:12.966+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:13.166 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:13.158+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:13.219 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:13.206+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:13.270 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:13.261+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:13.387 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:13.383+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:13.790 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:13.787+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:13.825 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:13.821+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:13.941 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:13.938+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:14.174 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:14.171+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:14.223 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:14.220+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:14.275 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:14.271+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:14.362 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:14.357+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:14.819 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:14.817+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:14.821 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:14.818+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:14.949 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:14.945+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:15.173 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:15.170+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:15.226 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:15.223+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:15.288 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:15.285+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:15.373 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:15.331+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:15.833 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:15.830+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:15.873 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:15.869+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:15.955 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:15.952+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:16.170 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:16.167+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:16.269 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:16.265+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:16.327 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:16.324+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:16.353 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:16.350+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:16.850 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:16.845+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:16.883 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:16.875+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:16.988 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:16.984+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:17.209 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:17.205+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:17.304 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:17.293+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:17.323 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:17.320+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:17.326 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:17.323+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:17.880 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:17.875+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:17.887 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:17.884+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:17.985 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:17.983+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:18.183 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:18.179+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:18.266 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:18.262+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:18.321 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:18.314+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:18.337 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:18.330+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:18.888 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:18.885+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:18.888 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:18.884+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:18.973 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:18.969+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:19.199 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:19.197+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:19.253 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:26:19.249+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.533452+0000 front 2019-11-27T23:25:19.892727+0000 (oldest deadline 2019-11-27T23:26:03.361359+0000) 2019-11-27T23:26:19.364 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:19.361+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:19.377 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:19.374+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:19.878 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:19.874+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:19.930 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:19.925+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:19.990 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:19.987+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:20.169 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:20.165+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:20.329 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:20.325+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:20.408 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:20.403+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:20.858 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:20.854+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:20.953 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:20.951+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:20.980 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:20.976+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:21.218 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:21.215+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:21.307 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:21.303+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:21.392 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:21.389+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:21.876 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:21.873+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:21.918 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:21.915+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:21.958 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:21.953+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:22.243 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:22.241+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:22.344 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:22.330+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:22.417 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:22.414+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:22.884 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:22.879+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:22.899 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:22.895+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:22.988 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:22.983+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:23.246 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:23.243+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:23.374 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:23.370+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:23.406 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:23.402+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:23.861 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:23.858+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:23.876 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:23.874+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:24.004 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:24.000+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:24.209 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:24.207+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:24.342 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:24.338+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:24.447 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:24.444+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:24.837 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:24.834+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:24.886 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:24.884+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:25.004 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:25.001+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:25.205 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:25.202+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:25.387 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:25.384+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:25.430 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:25.427+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:25.867 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:25.863+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:25.910 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:25.908+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:25.974 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:25.969+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:26.218 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:26.216+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:26.374 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:26.371+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:26.465 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:26.462+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:26.842 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:26.839+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:26.876 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:26.874+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:26.938 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:26.934+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:27.260 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:27.257+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:27.418 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:27.414+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:27.451 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:27.447+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:27.884 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:27.882+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:27.890 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:27.888+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:27.930 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:27.926+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:28.233 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:28.230+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:28.409 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:28.405+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:28.457 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:28.453+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:28.840 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:28.837+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:28.850 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:28.847+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:28.966 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:28.962+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:29.251 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:29.248+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:29.372 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:29.369+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:29.520 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:29.508+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:29.806 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:29.802+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:29.850 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:29.847+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:29.920 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:29.918+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:30.272 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:30.269+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:30.378 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:30.375+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:30.594 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:30.588+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:30.768 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:30.765+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:30.831 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:30.828+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:30.931 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:30.928+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:31.242 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:31.239+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:31.433 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:31.429+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:31.615 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:31.608+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:31.810 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:31.808+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:31.834 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:31.831+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:31.945 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:31.941+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:32.212 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:32.209+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:32.444 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:32.440+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:32.590 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:32.587+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:32.812 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:32.809+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:32.866 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:32.863+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:32.911 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:32.908+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:33.256 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:33.252+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:33.491 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:33.488+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:33.559 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:33.554+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:33.798 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:33.794+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:33.858 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:33.855+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:33.889 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:33.885+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:34.283 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:26:34.280+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:21.256556+0000 front 2019-11-27T23:25:20.528673+0000 (oldest deadline 2019-11-27T23:26:04.945731+0000) 2019-11-27T23:26:34.511 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:26:34.507+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:18.194017+0000 front 2019-11-27T23:25:18.165152+0000 (oldest deadline 2019-11-27T23:26:04.040395+0000) 2019-11-27T23:26:34.545 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:26:34.542+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:19.647930+0000 front 2019-11-27T23:25:19.664689+0000 (oldest deadline 2019-11-27T23:26:03.181576+0000) 2019-11-27T23:26:34.782 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:26:34.774+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.156:6810/10487,v1:172.21.15.156:6811/10487] for 42sec e213 v213) 2019-11-27T23:26:34.820 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:26:34.816+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:16.001816+0000 front 2019-11-27T23:25:16.002355+0000 (oldest deadline 2019-11-27T23:26:01.280431+0000) 2019-11-27T23:26:34.877 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:26:34.850+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.730366+0000 front 2019-11-27T23:25:21.273680+0000 (oldest deadline 2019-11-27T23:26:02.628518+0000) 2019-11-27T23:26:34.925 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:26:34.920+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:25:20.537768+0000 front 2019-11-27T23:25:21.257337+0000 (oldest deadline 2019-11-27T23:26:01.805747+0000) 2019-11-27T23:26:36.696 INFO:teuthology.orchestra.run.smithi156.stderr:testIfMatch (test.functional.tests.TestFileComparison) ... ok 2019-11-27T23:27:05.067 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:27:12.542 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.072 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:27:12.547 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.093 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:27:12.569 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.096 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:27:12.572 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.102 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:27:12.579 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.110 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:27:12.586 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.279 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:27:12.754 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.352 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:27:12.829 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:05.367 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:27:12.843 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:27:28.418 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:28.416+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:29.457 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:29.454+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:30.477 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:30.475+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:31.476 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:31.474+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:31.927 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:31.923+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:32.026 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:32.022+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:32.455 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:32.452+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:32.919 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:32.916+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:32.990 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:32.988+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:33.097 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:33.095+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:33.481 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:33.478+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:33.483 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:33.481+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:33.505 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:33.502+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:33.855 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:33.851+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:33.897 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:33.891+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:33.976 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:33.974+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:34.159 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:34.146+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:34.448 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:34.445+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:34.448 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:34.446+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:34.522 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:34.518+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:34.849 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:34.847+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:34.855 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:34.853+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:34.986 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:34.984+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:35.187 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:35.184+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:35.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:35.403+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:35.407 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:35.404+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:35.498 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:35.494+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:35.827 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:35.824+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:35.866 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:35.863+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:36.010 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:36.007+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:36.168 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:36.163+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:36.412 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:36.409+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:36.413 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:36.411+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:36.512 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:36.509+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:36.837 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:36.834+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:36.861 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:36.858+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:37.030 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:37.027+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:37.194 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:37.190+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:37.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:37.403+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:37.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:37.404+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:37.550 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:37.546+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:37.804 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:37.800+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:37.844 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:37.841+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:37.924 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:37.922+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:38.004 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:38.001+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:38.165 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:38.162+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:38.409 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:38.406+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:38.410 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:38.407+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:38.577 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:38.574+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:38.809 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:38.805+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:38.900 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:38.896+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:38.972 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:38.970+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:39.021 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:39.018+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:39.124 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:39.115+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:39.416 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:39.414+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:39.419 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:39.418+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:39.544 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:39.542+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:39.822 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:39.819+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:39.898 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:39.896+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:39.952 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:39.950+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:40.050 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:40.047+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:40.160 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:40.157+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:40.441 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:40.435+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:40.441 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:40.437+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:40.571 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:40.567+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:40.836 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:40.833+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:40.940 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:40.937+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:40.944 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:40.942+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:41.065 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:41.062+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:41.198 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:41.194+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:41.423 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:41.419+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:41.423 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:41.421+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:41.600 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:41.596+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:41.833 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:41.829+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:41.903 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:41.899+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:41.975 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:41.972+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:42.080 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:42.077+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:42.227 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:42.224+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:42.433 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:42.430+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:42.435 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:42.434+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:42.619 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:42.615+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:42.802 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:42.799+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:42.907 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:42.901+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:42.907 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:42.903+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:42.966 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:42.963+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:43.046 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:43.042+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:43.277 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:43.274+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:43.463 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:43.459+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:43.464 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:43.461+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:43.628 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:43.625+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:43.847 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:43.844+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:43.913 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:43.909+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:43.914 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:43.911+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:43.982 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:43.978+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:44.041 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:44.038+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:44.295 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:44.292+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:44.517 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:44.508+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:44.518 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:44.512+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:44.598 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:44.596+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:44.837 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:44.833+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:44.888 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:44.884+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:44.888 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:44.886+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:45.024 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:45.022+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:45.070 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:45.068+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:45.275 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:45.272+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:45.535 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:45.531+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:45.536 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:45.533+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:45.559 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:45.555+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:45.842 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:45.838+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:45.925 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:45.922+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:45.928 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:45.926+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:45.991 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:45.987+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:46.101 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:46.098+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:46.249 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:46.246+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:46.505 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:46.500+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:46.505 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:46.502+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:46.518 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:46.514+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:46.885 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:46.879+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:46.955 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:46.952+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:46.957 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:46.951+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:46.958 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:46.955+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:47.120 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:47.116+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:47.277 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:47.274+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:47.496 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:47.488+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:47.503 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:47.500+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:47.539 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:47.537+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:47.882 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:47.879+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:47.916 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:47.912+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:48.000 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:47.994+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:48.001 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:47.998+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:48.131 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:48.127+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:48.279 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:48.276+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:48.456 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:48.453+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:48.461 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:48.458+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:48.536 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:48.533+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:48.928 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:48.924+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:48.936 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:48.933+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:49.045 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:49.041+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:49.045 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:49.043+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:49.116 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:49.113+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:49.268 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:49.265+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:49.431 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:49.428+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:49.435 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:49.433+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:49.519 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:49.515+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:49.921 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:49.918+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:49.963 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:49.961+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:50.056 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:50.053+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:50.057 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:50.055+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:50.091 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:50.089+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:50.269 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:50.266+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:50.416 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:50.410+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:50.419 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:50.417+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:50.481 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:50.478+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:50.948 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:50.946+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:50.983 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:50.981+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:51.091 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:51.088+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:51.092 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:51.089+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:51.093 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:51.090+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:51.262 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:51.261+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:51.425 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:51.422+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:51.425 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:51.424+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:51.527 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:51.524+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:51.987 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:51.984+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:52.021 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:52.018+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:52.053 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:52.051+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:52.111 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:52.109+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:52.114 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:52.112+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:52.305 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:52.303+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:52.395 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:52.394+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:52.398 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:52.397+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:52.571 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:52.567+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:52.949 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:52.947+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:52.993 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:52.989+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:53.076 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:53.072+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:53.138 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:53.132+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:53.138 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:53.134+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:53.347 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:53.345+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:53.440 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:53.438+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:53.440 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:53.439+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:53.596 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:53.593+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:53.956 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:53.954+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:54.004 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:54.002+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:54.102 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:54.099+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:54.184 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:54.181+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:54.185 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:54.182+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:54.316 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:54.315+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:54.432 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:54.429+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:54.432 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:54.431+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:54.616 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:54.614+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:54.991 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:54.989+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:55.049 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:55.047+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:55.110 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:55.107+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:55.195 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:55.191+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:55.196 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:55.193+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:55.351 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:55.349+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:55.409 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:55.402+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:55.409 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:55.404+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:55.614 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:55.610+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:56.041 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:56.039+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:56.076 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:56.073+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:56.099 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:56.096+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:56.235 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:56.232+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:56.236 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:56.233+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:56.403 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:56.400+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:56.455 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:56.452+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:56.455 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:56.454+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:56.589 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:56.585+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:57.050 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:57.048+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:57.075 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:57.072+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:57.154 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:57.151+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:57.237 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:57.233+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:57.237 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:57.235+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:57.411 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:57.407+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:57.413 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:57.410+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:57.425 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:57.423+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:57.553 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:57.550+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:58.008 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:58.006+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:58.037 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:58.034+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:58.152 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:58.148+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:58.279 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:58.274+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:58.280 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:58.276+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:58.420 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:58.419+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:58.422 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:58.421+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:58.440 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:58.439+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:58.598 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:58.596+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:27:59.010 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:27:59.009+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:27:59.028 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:27:59.024+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:27:59.189 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:27:59.186+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:27:59.293 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:59.290+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:27:59.294 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:27:59.293+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:27:59.378 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:59.376+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:27:59.379 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:27:59.378+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:27:59.407 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:27:59.406+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:27:59.561 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:27:59.558+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:00.022 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:00.020+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:00.055 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:00.052+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:00.163 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:00.160+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:00.270 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:00.266+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:00.274 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:00.271+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:00.354 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:00.352+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:00.355 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:00.354+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:00.457 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:00.454+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:00.546 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:00.543+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:00.981 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:00.979+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:01.097 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:01.090+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:01.141 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:01.137+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:01.284 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:01.279+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:01.287 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:01.281+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:01.361 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:01.359+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:01.363 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:01.363+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:01.423 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:01.420+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:01.539 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:01.535+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:02.025 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:02.023+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:02.090 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:02.087+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:02.153 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:02.149+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:02.244 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:02.241+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:02.247 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:02.245+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:02.393 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:02.387+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:02.394 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:02.390+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:02.420 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:02.419+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:02.572 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:02.568+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:03.034 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:03.029+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:03.074 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:03.071+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:03.135 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:03.133+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:03.220 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:03.216+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:03.221 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:03.218+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:03.384 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:03.381+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:03.385 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:03.384+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:03.397 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:03.396+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:03.576 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:03.573+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:04.045 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:04.033+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:04.079 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:04.077+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:04.156 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:04.153+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:04.192 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:04.189+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:04.193 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:04.191+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:04.401 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:04.398+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:04.402 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:04.401+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:04.454 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:04.451+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:04.547 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:04.543+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:05.043 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:28:05.040+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 41sec e218 v218) 2019-11-27T23:28:05.080 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:05.076+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:05.124 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:05.122+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:05.141 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:05.138+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:05.199 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:05.195+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:05.200 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:05.197+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:05.415 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:05.413+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:05.453 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:05.449+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:05.454 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:05.452+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:05.547 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:05.544+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:06.124 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:06.120+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:06.157 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:06.154+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:06.160 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:06.158+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:06.236 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:06.233+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:06.236 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:06.234+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:06.403 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:06.402+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:06.407 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:06.406+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:06.439 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:06.436+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:06.440 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:06.437+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:06.582 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:06.579+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:07.136 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:07.132+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:07.156 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:07.153+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:07.164 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:07.162+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:07.242 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:07.239+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:07.244 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:07.242+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:07.369 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:07.367+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:07.370 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:07.368+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:07.457 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:07.454+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:07.457 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:07.456+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:07.616 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:07.612+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:08.138 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:08.136+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:08.176 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:08.172+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:08.202 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:08.199+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:08.232 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:08.227+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:08.232 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:08.229+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:08.366 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:08.362+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:08.368 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:08.363+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:08.444 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:08.442+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:08.444 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:08.443+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:08.634 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:08.630+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:09.144 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:09.142+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:09.197 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:09.194+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:09.205 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:09.201+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:09.257 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:09.254+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:09.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:09.257+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:09.404 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:09.398+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:09.404 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:09.402+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:09.406 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:09.400+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:09.407 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:09.406+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:09.606 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:09.603+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:10.062 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:28:10.060+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 41sec e218 v218) 2019-11-27T23:28:10.129 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:10.128+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:10.163 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:10.160+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:10.244 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:10.241+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:10.255 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:10.252+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:10.256 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:10.253+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:10.383 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:10.381+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:10.386 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:10.385+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:10.417 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:10.414+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:10.417 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:10.416+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:10.600 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:10.595+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:11.107 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:11.106+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:11.174 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:11.171+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:11.246 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:11.243+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:11.246 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:11.244+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:11.257 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:11.253+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:11.374 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:11.372+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:11.378 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:11.376+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:11.448 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:11.446+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:11.451 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:11.450+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:11.585 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:11.581+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:12.143 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:12.140+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:12.168 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:12.165+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:12.255 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:12.252+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:12.256 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:12.253+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:12.281 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:12.279+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:12.402 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:12.401+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:12.405 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:12.404+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:12.424 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:12.423+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:12.425 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:12.425+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:12.605 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:12.602+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:13.185 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:13.184+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:13.204 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:13.201+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:13.239 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:13.236+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:13.240 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:13.237+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:13.245 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:13.243+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:13.403 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:13.402+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:13.408 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:13.406+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:13.445 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:13.438+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:13.446 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:13.442+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:13.620 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:13.617+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:14.183 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:14.180+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:14.194 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:14.190+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:14.247 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:14.244+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:14.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:14.257+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:14.260 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:14.258+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:14.418 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:14.413+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:14.420 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:14.415+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:14.433 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:14.431+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:14.433 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:14.432+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:14.594 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:14.591+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:15.082 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:28:15.079+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 41sec e218 v218) 2019-11-27T23:28:15.150 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:15.149+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:15.171 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:15.166+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:15.267 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:15.265+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:15.300 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:15.298+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:15.301 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:15.299+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:15.410 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:15.407+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:15.411 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:15.410+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:15.475 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:15.473+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:15.475 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:15.474+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:15.593 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:15.589+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:16.125 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:16.123+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:16.166 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:16.163+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:16.280 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:16.278+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:16.280 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:16.279+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:16.316 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:16.313+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:16.436 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:16.434+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:16.439 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:16.438+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:16.455 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:16.454+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:16.458 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:16.457+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:16.549 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:16.547+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:17.142 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:17.140+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:17.187 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:17.184+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:17.304 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:17.301+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:17.305 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:17.303+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:17.329 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:17.327+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:17.458 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:17.456+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:17.459 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:17.459+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:17.473 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:17.471+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:17.477 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:17.475+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:17.537 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:17.534+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:18.112 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:18.110+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:18.173 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:18.170+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:18.297 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:18.295+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:18.298 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:18.297+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:18.380 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:18.374+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:18.448 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:18.446+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:18.448 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:18.448+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:18.456 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:18.456+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:18.457 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:18.457+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:18.497 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:18.495+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:19.149 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:19.147+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:19.162 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:19.159+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:19.309 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:19.306+0000 1694c700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 ever on either front or back, first ping sent 2019-11-27T23:27:02.445357+0000 (oldest deadline 2019-11-27T23:27:42.445357+0000) 2019-11-27T23:28:19.309 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:19.307+0000 1694c700 -1 osd.2 218 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:19.340 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:19.338+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:19.438 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:19.434+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:19.439 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:19.437+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:19.462 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:19.457+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:19.488 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:19.486+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:19.491 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:19.490+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:20.131 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:28:20.128+0000 1694c700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.858036+0000 front 2019-11-27T23:26:50.857446+0000 (oldest deadline 2019-11-27T23:27:31.058245+0000) 2019-11-27T23:28:20.157 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:28:20.151+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 41sec e218 v218) 2019-11-27T23:28:20.187 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:28:20.186+0000 1694c700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.504689+0000 front 2019-11-27T23:26:49.685946+0000 (oldest deadline 2019-11-27T23:27:33.109661+0000) 2019-11-27T23:28:20.314 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:28:20.311+0000 1694c700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:49.502309+0000 front 2019-11-27T23:26:48.630346+0000 (oldest deadline 2019-11-27T23:27:31.708528+0000) 2019-11-27T23:28:20.337 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:28:20.329+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-27T23:28:20.435 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:28:20.433+0000 1694c700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.814993+0000 front 2019-11-27T23:26:49.686229+0000 (oldest deadline 2019-11-27T23:27:32.710264+0000) 2019-11-27T23:28:20.436 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:20.435+0000 1694c700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:50.816099+0000 front 2019-11-27T23:26:49.265077+0000 (oldest deadline 2019-11-27T23:27:32.602930+0000) 2019-11-27T23:28:20.437 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:20.436+0000 1694c700 -1 osd.4 218 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:20.521 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:20.520+0000 1694c700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:26:51.815395+0000 front 2019-11-27T23:26:51.812745+0000 (oldest deadline 2019-11-27T23:27:32.300361+0000) 2019-11-27T23:28:20.522 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:20.521+0000 1694c700 -1 osd.6 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:21.439 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:21.413+0000 1694c700 -1 osd.4 219 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:21.551 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:21.532+0000 1694c700 -1 osd.6 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:22.426 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:22.424+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:22.491 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:22.488+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:23.386 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:23.384+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:23.485 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:23.484+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:24.343 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:24.341+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:24.440 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:24.439+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:25.305 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:25.303+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:25.458 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:25.457+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:26.336 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:26.335+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:26.479 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:26.478+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:27.340 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:27.337+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:27.441 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:27.439+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:28.366 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:28.365+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:28.477 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:28.476+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:29.399 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:29.397+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:29.450 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:29.448+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:30.433 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:30.432+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:30.439 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:30.438+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:31.436 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:31.434+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:31.454 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:31.452+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:32.461 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:32.459+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:32.479 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:32.478+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:33.461 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:33.460+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:33.502 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:33.501+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:34.509 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:34.508+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:34.546 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:34.545+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:35.549 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:35.548+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:35.593 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:35.591+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:36.588 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:36.586+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:36.589 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:36.587+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:37.563 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:37.561+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:37.615 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:37.613+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:38.558 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:38.557+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:38.615 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:38.611+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:39.540 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:39.538+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:39.585 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:39.584+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:40.573 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:40.570+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:40.579 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:40.575+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:41.588 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:41.586+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:41.616 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:41.612+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:42.592 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:42.589+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:42.608 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:42.606+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:43.599 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:43.597+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:43.610 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:43.608+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:44.620 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:44.619+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:44.643 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:44.641+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:45.666 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:45.662+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:45.674 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:45.672+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:46.694 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:46.692+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:46.712 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:46.710+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:47.683 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:47.681+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:47.698 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:47.695+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:48.670 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:48.668+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:48.693 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:48.691+0000 1694c700 -1 osd.4 220 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:49.700 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:28:49.698+0000 1694c700 -1 osd.6 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:125816 3.36 3:6de8ac81:::.dir.52e9f6d5-9017-4df2-9490-35fe7d8cf870.4546.656:head [call rgw.bucket_list in=43b] snapc 0=[] ondisk+read+known_if_redirected e218) 2019-11-27T23:28:49.811 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:28:49.756+0000 1694c700 -1 osd.4 221 get_health_metrics reporting 16 slow ops, oldest is osd_op(client.4537.0:125740 5.e 5:7759931f:::notify.3:head [watch ping cookie 442256608 gen 1] snapc 0=[] ondisk+write+known_if_redirected e215) 2019-11-27T23:28:50.042 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:28:50.040+0000 20e22700 -1 RGWWatcher::handle_error cookie 442256608 err (107) Transport endpoint is not connected 2019-11-27T23:28:56.818 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:56.789+0000 31f84700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:56.931 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:56.889+0000 31783700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:56.951 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:56.914+0000 33f88700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.310 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.076+0000 3678d700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.361 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.160+0000 35f8c700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.422 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.205+0000 33787700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.497 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.238+0000 31f84700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.523 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.309+0000 37f90700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.525 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.329+0000 38791700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:28:57.527 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:28:57.340+0000 34789700 -1 osd.5 223 build_incremental_map_msg missing incremental map 223 2019-11-27T23:29:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:testIfMatchAndUnmodified (test.functional.tests.TestFileComparison) ... ok 2019-11-27T23:29:56.474 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:29:56.471+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:29:57.061 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:29:57.057+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:29:57.499 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:29:57.494+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:29:57.512 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:29:57.509+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:29:57.739 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:29:57.736+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:29:58.101 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:29:58.097+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:29:58.114 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:29:58.107+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:29:58.491 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:29:58.489+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:29:58.524 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:29:58.521+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:29:58.734 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:29:58.732+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:29:59.081 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:29:59.075+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:29:59.163 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:29:59.159+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:29:59.454 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:29:59.451+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:29:59.513 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:29:59.508+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:29:59.515 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:29:59.511+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:29:59.740 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:29:59.736+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:00.037 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:00.034+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:00.130 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:00.126+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:00.482 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:00.479+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:00.503 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:00.500+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:00.531 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:00.519+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:00.780 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:00.777+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:00.878 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:00.874+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:01.057 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:01.051+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:01.110 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:01.108+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:01.312 INFO:teuthology.orchestra.run.smithi156.stderr:testIfModifiedSince (test.functional.tests.TestFileComparison) ... ok 2019-11-27T23:30:01.459 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:01.457+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:01.513 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:01.510+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:01.535 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:01.532+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:01.764 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:01.761+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:01.895 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:01.890+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:02.090 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:02.087+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:02.139 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:02.135+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:02.477 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:02.474+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:02.503 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:02.501+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:02.560 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:02.556+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:02.809 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:02.804+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:02.937 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:02.932+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:03.095 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:03.090+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:03.127 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:03.124+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:03.471 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:03.466+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:03.498 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:03.495+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:03.579 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:03.575+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:03.796 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:03.792+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:03.990 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:03.985+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:04.126 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:04.122+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:04.182 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:04.178+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:04.493 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:04.490+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:04.505 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:04.503+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:04.632 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:04.628+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:04.785 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:04.780+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:04.949 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:04.945+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:05.097 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:05.093+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:05.142 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:05.138+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:05.538 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:05.534+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:05.552 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:05.549+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:05.671 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:05.668+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:05.810 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:05.807+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:05.992 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:05.987+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:06.153 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:06.149+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:06.170 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:06.167+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:06.582 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:06.580+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:06.584 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:06.581+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:06.656 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:06.651+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:06.820 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:06.816+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:06.992 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:06.987+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:07.131 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:07.127+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:07.202 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:07.198+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:07.538 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:07.535+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:07.602 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:07.600+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:07.616 INFO:tasks.ceph.osd.2.smithi156.stderr:*** Caught signal (Segmentation fault) ** 2019-11-27T23:30:07.616 INFO:tasks.ceph.osd.2.smithi156.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-27T23:30:07.621 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:07.616+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:07.798 INFO:tasks.ceph.osd.2.smithi156.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:30:07.798 INFO:tasks.ceph.osd.2.smithi156.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe899b1] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100b010] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017db3] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1018030] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101858d] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1001214] 2019-11-27T23:30:07.799 INFO:tasks.ceph.osd.2.smithi156.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb864] 2019-11-27T23:30:07.800 INFO:tasks.ceph.osd.2.smithi156.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3cd55] 2019-11-27T23:30:07.800 INFO:tasks.ceph.osd.2.smithi156.stderr: 10: (()+0xd3a767) [0xe42767] 2019-11-27T23:30:07.800 INFO:tasks.ceph.osd.2.smithi156.stderr: 11: (()+0x12126bf) [0x131a6bf] 2019-11-27T23:30:07.800 INFO:tasks.ceph.osd.2.smithi156.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-27T23:30:07.800 INFO:tasks.ceph.osd.2.smithi156.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:30:07.819 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:07.816+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:07.989 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:07.985+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:08.097 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:08.094+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:08.186 INFO:tasks.ceph.osd.2.smithi156.stderr:2019-11-27T23:30:08.180+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe899b1] 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100b010] 2019-11-27T23:30:08.187 INFO:tasks.ceph.osd.2.smithi156.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017db3] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1018030] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101858d] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1001214] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb864] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3cd55] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 10: (()+0xd3a767) [0xe42767] 2019-11-27T23:30:08.188 INFO:tasks.ceph.osd.2.smithi156.stderr: 11: (()+0x12126bf) [0x131a6bf] 2019-11-27T23:30:08.189 INFO:tasks.ceph.osd.2.smithi156.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-27T23:30:08.189 INFO:tasks.ceph.osd.2.smithi156.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:30:08.189 INFO:tasks.ceph.osd.2.smithi156.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:30:08.189 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:08.257 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:08.254+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:08.575 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:08.571+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:08.599 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:08.596+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:08.642 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:08.638+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:08.847 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:08.845+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:08.968 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:08.964+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:09.024 INFO:tasks.ceph.osd.2.smithi156.stderr: -761> 2019-11-27T23:30:08.180+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-27T23:30:09.024 INFO:tasks.ceph.osd.2.smithi156.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-27T23:30:09.024 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:09.024 INFO:tasks.ceph.osd.2.smithi156.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:30:09.024 INFO:tasks.ceph.osd.2.smithi156.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe899b1] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100b010] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017db3] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1018030] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101858d] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1001214] 2019-11-27T23:30:09.025 INFO:tasks.ceph.osd.2.smithi156.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb864] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3cd55] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 10: (()+0xd3a767) [0xe42767] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 11: (()+0x12126bf) [0x131a6bf] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:30:09.026 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:09.149 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:09.145+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:09.293 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:09.289+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:09.465 INFO:tasks.ceph.osd.2.smithi156.stderr: -1762> 2019-11-27T23:30:08.180+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-27T23:30:09.465 INFO:tasks.ceph.osd.2.smithi156.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-27T23:30:09.465 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:09.465 INFO:tasks.ceph.osd.2.smithi156.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe899b1] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100b010] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017db3] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1018030] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101858d] 2019-11-27T23:30:09.466 INFO:tasks.ceph.osd.2.smithi156.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1001214] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb864] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3cd55] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 10: (()+0xd3a767) [0xe42767] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 11: (()+0x12126bf) [0x131a6bf] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:30:09.467 INFO:tasks.ceph.osd.2.smithi156.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:30:09.468 INFO:tasks.ceph.osd.2.smithi156.stderr: 2019-11-27T23:30:09.554 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:09.551+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:09.600 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:09.598+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:09.649 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:09.645+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:09.901 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:09.896+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:09.942 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:09.939+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:10.120 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:10.116+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:10.330 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:10.326+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:10.545 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:10.541+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:10.624 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:10.620+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:10.628 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:10.624+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:10.905 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:10.901+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:10.927 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:10.923+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:11.164 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:11.161+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:11.337 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:30:11.333+0000 1694c700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.228925+0000 front 2019-11-27T23:29:13.230952+0000 (oldest deadline 2019-11-27T23:29:56.844215+0000) 2019-11-27T23:30:11.500 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:30:11.497+0000 1694c700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.304202+0000 front 2019-11-27T23:29:14.249217+0000 (oldest deadline 2019-11-27T23:29:59.508464+0000) 2019-11-27T23:30:11.610 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:30:11.607+0000 1694c700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.146351+0000 front 2019-11-27T23:29:15.557030+0000 (oldest deadline 2019-11-27T23:29:55.945289+0000) 2019-11-27T23:30:11.643 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:30:11.638+0000 1694c700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:16.023416+0000 front 2019-11-27T23:29:16.079560+0000 (oldest deadline 2019-11-27T23:29:57.016423+0000) 2019-11-27T23:30:11.922 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:30:11.918+0000 1694c700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:12.346815+0000 front 2019-11-27T23:29:12.435948+0000 (oldest deadline 2019-11-27T23:29:56.763023+0000) 2019-11-27T23:30:11.969 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:30:11.966+0000 1694c700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:14.767742+0000 front 2019-11-27T23:29:15.688595+0000 (oldest deadline 2019-11-27T23:30:00.044212+0000) 2019-11-27T23:30:12.143 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:30:12.139+0000 1694c700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.156:6814 osd.2 since back 2019-11-27T23:29:13.927795+0000 front 2019-11-27T23:29:13.936246+0000 (oldest deadline 2019-11-27T23:29:57.369847+0000) 2019-11-27T23:30:12.331 INFO:tasks.ceph.osd.2.smithi156.stderr:daemon-helper: command crashed with signal 11 2019-11-27T23:30:15.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2019-11-27T23:30:22.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2019-11-27T23:30:28.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2019-11-27T23:30:34.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~19s 2019-11-27T23:30:41.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2019-11-27T23:30:47.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~32s 2019-11-27T23:30:53.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~38s 2019-11-27T23:31:00.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2019-11-27T23:31:00.958 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:08.433 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:00.968 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:08.443 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:00.981 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:08.457 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:00.981 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:08.457 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:00.985 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:08.462 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:00.988 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:08.465 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:01.213 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:08.689 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:01.231 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:08.707 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:01.307 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:08.782 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:06.158 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:06.156+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:06.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2019-11-27T23:31:07.149 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:07.147+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:08.154 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:08.151+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:09.155 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:09.152+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:09.875 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:09.870+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:10.118 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:10.115+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:10.118 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:10.116+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:10.796 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:10.791+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:10.893 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:10.889+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:11.097 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:11.086+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:11.100 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:11.091+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:11.367 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:11.364+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:11.615 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:11.613+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:11.793 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:11.790+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:11.917 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:11.913+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:12.068 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:12.065+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:12.068 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:12.067+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:12.265 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:12.262+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:12.413 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:12.409+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:12.576 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:12.573+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:12.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~57s 2019-11-27T23:31:12.768 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:12.765+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:12.928 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:12.924+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:13.024 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:13.020+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:13.027 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:13.025+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:13.236 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:13.233+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:13.438 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:13.435+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:13.582 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:13.578+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:13.742 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:13.739+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:13.962 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:13.959+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:14.021 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:14.017+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:14.039 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:14.037+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:14.214 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:14.211+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:14.405 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:14.403+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:14.584 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:14.581+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:14.720 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:14.716+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:14.950 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:14.946+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:14.996 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:14.993+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:14.997 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:14.994+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:15.193 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:15.190+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:15.423 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:15.420+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:15.605 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:15.602+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:15.712 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:15.709+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:15.979 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:15.976+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:16.044 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:16.039+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:16.044 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:16.042+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:16.238 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:16.235+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:16.433 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:16.430+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:16.606 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:16.603+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:16.760 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:16.757+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:16.972 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:16.969+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:17.020 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:17.017+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:17.023 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:17.021+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:17.261 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:17.256+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:17.453 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:17.450+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:17.654 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:17.651+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:17.774 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:17.770+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:17.936 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:17.932+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:18.069 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:18.065+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:18.070 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:18.067+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:18.281 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:18.278+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:18.470 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:18.467+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:18.629 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:18.626+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:18.777 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:18.774+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:18.948 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:18.945+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:19.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~63s 2019-11-27T23:31:19.052 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:19.048+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:19.053 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:19.050+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:19.289 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:19.285+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:19.470 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:19.467+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:19.648 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:19.645+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:19.742 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:19.738+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:19.937 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:19.933+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:20.038 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:20.034+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:20.040 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:20.036+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:20.325 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:20.321+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:20.461 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:20.458+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:20.639 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:20.637+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:20.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:20.750+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:20.951 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:20.949+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:21.038 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:28.513 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.066 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:21.062+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:21.067 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:21.064+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:21.068 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:28.543 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.093 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:28.569 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.102 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:28.578 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.107 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:28.583 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.108 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:28.584 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.111 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:31:28.586 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.141 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:31:28.617 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.154 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:31:28.630 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:31:21.372 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:21.370+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:21.509 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:21.506+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:21.611 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:21.608+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:21.766 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:21.762+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:21.909 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:21.907+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:22.115 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:22.112+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:22.117 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:22.116+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:22.418 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:22.415+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:22.491 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:22.488+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:22.628 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:22.625+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:22.809 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:22.806+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:22.882 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:22.878+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:23.108 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:23.106+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:23.111 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:23.109+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:23.425 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:23.422+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:23.493 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:23.490+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:23.591 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:23.586+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:23.785 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:23.783+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:23.844 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:23.840+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:24.128 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:24.125+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:24.129 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:24.127+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:24.447 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:24.444+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:24.521 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:24.517+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:24.556 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:24.552+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:24.765 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:24.763+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:24.822 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:24.820+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:25.106 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:25.102+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:25.107 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:25.104+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:25.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~69s 2019-11-27T23:31:25.417 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:25.414+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:25.500 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:25.496+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:25.548 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:25.544+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:25.786 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:25.784+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:25.860 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:25.857+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:26.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:26.096+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:26.099 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:26.097+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:26.439 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:26.437+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:26.459 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:26.457+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:26.567 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:26.565+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:26.746 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:26.742+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:26.832 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:26.830+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:27.151 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:27.147+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:27.152 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:27.149+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:27.444 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:27.442+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:27.471 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:27.468+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:27.607 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:27.605+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:27.786 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:27.783+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:27.786 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:27.784+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:28.153 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:28.149+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:28.156 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:28.154+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:28.425 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:28.422+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:28.470 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:28.467+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:28.604 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:28.600+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:28.772 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:28.769+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:28.828 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:28.825+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:29.151 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:29.146+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:29.152 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:29.148+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:29.402 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:29.399+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:29.480 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:29.477+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:29.578 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:29.574+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:29.823 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:29.819+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:29.837 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:29.834+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:30.176 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:30.172+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:30.177 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:30.174+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:30.403 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:30.391+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:30.480 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:30.477+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:30.586 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:30.582+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:30.798 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:30.794+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:30.864 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:30.860+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:31.162 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:31.161+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:31.165 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:31.164+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:31.418 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:31.416+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:31.519 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:31.515+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:31.601 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:31.599+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:31.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2019-11-27T23:31:31.839 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:31.836+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:31.862 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:31.860+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:32.130 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:32.129+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:32.133 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:32.132+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:32.446 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:32.445+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:32.509 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:32.499+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:32.564 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:32.561+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:32.882 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:32.878+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:32.894 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:32.892+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:33.164 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:33.162+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:33.167 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:33.166+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:33.443 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:33.441+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:33.527 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:33.524+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:33.563 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:33.560+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:33.857 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:33.855+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:33.881 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:33.878+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:34.194 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:34.191+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:34.195 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:34.193+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:34.405 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:34.403+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:34.559 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:34.556+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:34.572 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:34.569+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:34.815 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:34.814+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:34.914 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:34.911+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:35.171 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:35.168+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:35.172 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:35.170+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:35.375 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:35.372+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:35.541 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:35.537+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:35.569 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:35.566+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:35.832 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:35.830+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:35.935 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:35.931+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:36.127 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:36.125+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:36.130 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:36.129+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:36.406 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:36.404+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:36.546 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:36.542+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:36.592 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:36.589+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:36.859 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:36.859+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:36.919 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:36.916+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:37.096 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:37.095+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:37.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:37.096+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:37.402 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:37.401+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:37.509 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:37.506+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:37.553 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:37.549+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:37.899 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:37.898+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:37.944 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:37.940+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:37.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2019-11-27T23:31:38.102 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:38.102+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:38.107 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:38.104+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:38.432 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:38.430+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:38.497 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:38.494+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:38.582 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:38.579+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:38.921 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:38.917+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:38.939 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:38.936+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:39.135 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:39.132+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:39.136 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:39.134+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:39.481 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:39.480+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:39.513 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:39.509+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:39.572 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:39.568+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:39.925 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:39.919+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:39.975 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:39.973+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:40.109 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:40.105+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:40.110 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:40.108+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:40.480 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:40.476+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:40.521 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:40.520+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:40.558 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:40.554+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:40.913 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:40.910+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:41.024 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:41.021+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:41.081 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:31:41.080+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e229 v229) 2019-11-27T23:31:41.149 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:41.146+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:41.150 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:41.148+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:41.478 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:41.474+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:41.487 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:41.486+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:41.528 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:41.525+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:41.926 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:41.922+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:42.060 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:42.057+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:42.140 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:42.136+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:42.140 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:42.139+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:42.496 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:42.495+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:42.508 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:42.503+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:42.559 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:42.556+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:42.893 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:42.890+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:43.021 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:43.020+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:43.164 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:43.162+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:43.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:43.167+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:43.480 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:43.477+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:43.522 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:43.519+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:43.525 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:43.523+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:43.881 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:43.877+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:43.986 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:43.985+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:44.206 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:44.203+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:44.207 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:44.205+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:44.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2019-11-27T23:31:44.477 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:44.473+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:44.547 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:44.544+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:44.571 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:44.570+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:44.907 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:44.903+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:45.013 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:45.010+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:45.180 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:45.175+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:45.181 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:45.179+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:45.496 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:31:45.493+0000 1694c700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.470085+0000 front 2019-11-27T23:30:28.545304+0000 (oldest deadline 2019-11-27T23:31:11.323361+0000) 2019-11-27T23:31:45.540 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:45.539+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:45.594 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:31:45.589+0000 1694c700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.970486+0000 front 2019-11-27T23:30:27.273179+0000 (oldest deadline 2019-11-27T23:31:10.400738+0000) 2019-11-27T23:31:45.896 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:31:45.893+0000 1694c700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.516761+0000 front 2019-11-27T23:30:26.550977+0000 (oldest deadline 2019-11-27T23:31:09.856871+0000) 2019-11-27T23:31:45.990 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:31:45.989+0000 1694c700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:28.549117+0000 front 2019-11-27T23:30:28.546530+0000 (oldest deadline 2019-11-27T23:31:10.289369+0000) 2019-11-27T23:31:46.161 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:31:46.157+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e229 v229) 2019-11-27T23:31:46.167 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:46.165+0000 1694c700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:29.991597+0000 front 2019-11-27T23:30:29.621525+0000 (oldest deadline 2019-11-27T23:31:10.081596+0000) 2019-11-27T23:31:46.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:46.167+0000 1694c700 -1 osd.4 229 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:46.581 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:31:46.580+0000 1694c700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:30:26.693278+0000 front 2019-11-27T23:30:26.367703+0000 (oldest deadline 2019-11-27T23:31:11.924023+0000) 2019-11-27T23:31:47.159 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:47.158+0000 1694c700 -1 osd.4 230 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:48.192 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:48.191+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:49.170 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:49.169+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:50.133 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:50.131+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:50.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2019-11-27T23:31:51.176 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:51.174+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:52.160 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:52.152+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:53.124 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:53.123+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:54.152 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:54.150+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:55.126 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:55.122+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:56.172 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:56.171+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:56.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~101s 2019-11-27T23:31:57.186 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:57.184+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:58.148 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:58.145+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:31:59.111 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:31:59.109+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:00.102 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:00.100+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:01.125 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:01.123+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:02.164 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:02.163+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:03.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~107s 2019-11-27T23:32:03.218 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:03.216+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:04.196 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:04.194+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:05.219 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:05.217+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:06.255 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:06.254+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:07.290 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:07.288+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:08.289 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:08.287+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:09.298 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:09.296+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:09.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~114s 2019-11-27T23:32:10.274 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:10.272+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:11.292 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:11.289+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:11.348 INFO:teuthology.orchestra.run.smithi156.stderr:testIfNoneMatch (test.functional.tests.TestFileComparison) ... ok 2019-11-27T23:32:12.258 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:12.255+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:13.232 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:13.230+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:14.270 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:14.268+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:15.272 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:15.269+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:15.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2019-11-27T23:32:16.233 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:16.230+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:17.253 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:17.251+0000 1694c700 -1 osd.4 231 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:18.389 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:32:18.387+0000 1694c700 -1 osd.4 232 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:126302 5.e 5:7759931f:::notify.3:head [watch ping cookie 5427225248 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-11-27T23:32:19.014 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:32:18.881+0000 20e22700 -1 RGWWatcher::handle_error cookie 5427225248 err (107) Transport endpoint is not connected 2019-11-27T23:32:22.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~126s 2019-11-27T23:32:28.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~133s 2019-11-27T23:32:32.900 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:32.867+0000 3578b700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:33.159 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:33.061+0000 31783700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:33.333 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:33.159+0000 31f84700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:33.844 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:33.789+0000 38f92700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:33.960 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:33.882+0000 31783700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:33.978 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:32:33.939+0000 34789700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-11-27T23:32:34.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~139s 2019-11-27T23:32:41.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2019-11-27T23:32:47.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~151s 2019-11-27T23:32:53.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2019-11-27T23:33:00.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~164s 2019-11-27T23:33:01.559 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:01.558+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:02.600 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:02.597+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:03.609 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:03.607+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:04.647 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:04.644+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:05.694 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:05.692+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:06.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2019-11-27T23:33:06.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:06.688+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:07.649 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:07.648+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:08.638 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:08.636+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:09.622 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:09.620+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:10.574 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:10.572+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:11.564 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:11.562+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:12.599 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:12.597+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:12.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~177s 2019-11-27T23:33:13.614 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:13.613+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:14.602 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:14.600+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:15.633 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:15.631+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:16.667 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:16.666+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:17.641 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:17.639+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:18.639 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:18.638+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:18.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~183s 2019-11-27T23:33:19.685 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:19.684+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:20.655 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:20.651+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:21.685 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:21.683+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:22.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:22.700+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:23.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:23.746+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:24.793 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:24.792+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:25.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~189s 2019-11-27T23:33:25.843 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:25.842+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:26.878 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:26.877+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:27.860 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:27.859+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:28.906 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:28.904+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:29.077 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:29.072+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:29.876 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:29.874+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:30.063 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:30.060+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:30.098 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:30.095+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:30.730 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:30.726+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:30.838 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:30.836+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:31.074 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:31.071+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:31.129 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:31.126+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:31.193 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:31.183+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:31.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~196s 2019-11-27T23:33:31.711 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:31.707+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:31.801 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:31.800+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:31.804 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:31.803+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:32.073 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:32.070+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:32.112 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:32.109+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:32.172 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:32.168+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:32.690 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:32.688+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:32.774 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:32.771+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:32.779 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:32.776+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:33.080 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:33.077+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:33.087 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:33.085+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:33.159 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:33.154+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:33.695 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:33.692+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:33.794 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:33.791+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:33.799 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:33.796+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:33.925 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:33.922+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:34.062 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:34.060+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:34.091 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:34.089+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:34.164 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:34.162+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:34.717 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:34.714+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:34.772 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:34.769+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:34.773 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:34.770+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:34.946 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:34.943+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:35.084 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:35.081+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:35.108 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:35.105+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:35.136 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:35.133+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:35.759 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:35.754+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:35.761 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:35.758+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:35.766 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:35.763+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:35.960 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:35.957+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:36.075 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:36.072+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:36.109 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:36.106+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:36.147 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:36.143+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:36.737 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:36.732+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:36.738 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:36.735+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:36.742 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:36.739+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:36.976 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:36.969+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:37.039 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:37.036+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:37.102 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:37.099+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:37.162 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:37.159+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:37.741 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:37.738+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:37.746 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:37.743+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:37.793 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:37.789+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:37.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~202s 2019-11-27T23:33:37.996 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:37.993+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:38.061 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:38.058+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:38.092 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:38.087+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:38.202 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:38.198+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:38.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:38.715+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:38.720 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:38.717+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:38.802 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:38.798+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:39.052 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:39.046+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:39.064 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:39.061+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:39.088 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:39.085+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:39.235 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:39.222+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:39.684 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:39.681+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:39.687 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:39.685+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:39.810 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:39.808+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:40.025 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:40.020+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:40.052 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:40.048+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:40.073 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:40.069+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:40.187 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:40.183+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:40.683 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:40.680+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:40.688 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:40.685+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:40.845 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:40.841+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:41.013 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:41.009+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:41.069 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:41.060+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:41.119 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:41.113+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:41.163 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:41.160+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:41.646 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:41.644+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:41.647 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:41.645+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:41.827 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:41.824+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:41.982 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:41.980+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:42.061 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:42.058+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:42.111 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:42.106+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:42.152 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:42.148+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:42.602 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:42.600+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:42.605 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:42.602+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:42.827 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:42.823+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:42.988 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:42.984+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:43.058 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:43.054+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:43.102 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:43.098+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:43.163 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:43.159+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:43.642 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:43.636+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:43.643 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:43.640+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:43.802 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:43.798+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:43.955 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:43.952+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:44.018 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:44.015+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:44.133 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:44.129+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:44.197 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:44.194+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:44.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~208s 2019-11-27T23:33:44.600 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:44.596+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:44.600 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:44.598+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:44.851 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:44.848+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:44.920 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:44.918+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:45.025 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:45.021+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:45.187 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:45.183+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:45.189 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:45.186+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:45.590 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:45.587+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:45.594 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:45.591+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:45.867 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:45.864+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:45.935 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:45.932+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:46.061 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:46.057+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:46.189 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:46.186+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:46.194 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:46.190+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:46.589 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:46.585+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:46.590 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:46.588+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:46.910 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:46.906+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:46.921 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:46.919+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:47.104 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:47.101+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:47.209 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:47.201+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:47.234 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:47.231+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:47.623 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:47.619+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:47.624 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:47.621+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:47.898 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:47.895+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:47.906 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:47.904+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:48.129 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:48.125+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:48.248 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:48.244+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:48.287 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:48.284+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:48.593 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:48.589+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:48.594 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:48.591+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:48.905 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:33:48.902+0000 1694c700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:46.721784+0000 front 2019-11-27T23:32:49.828322+0000 (oldest deadline 2019-11-27T23:33:30.184217+0000) 2019-11-27T23:33:48.935 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:48.931+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:49.088 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:49.084+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:49.244 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:49.241+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:49.253 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:49.249+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:49.573 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:49.570+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:49.577 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:49.574+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:49.942 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:49.939+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:50.141 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:50.137+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:50.211 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:50.207+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:50.300 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:50.297+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:50.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2019-11-27T23:33:50.581 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:50.576+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:50.583 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:50.579+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:50.905 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:50.901+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:51.130 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:51.126+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:51.231 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:51.227+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:51.330 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:51.327+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:51.635 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:51.630+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:51.636 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:51.633+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:51.950 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:51.947+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:52.097 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:52.094+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:52.274 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:52.271+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:52.352 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:52.348+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:52.666 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:52.663+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:52.667 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:52.664+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:52.921 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:52.918+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:53.097 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:53.094+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:53.323 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:53.321+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:53.327 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:53.323+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:53.714 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:53.711+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:53.717 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:53.714+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:53.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:53.881+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:54.131 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:54.128+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:54.323 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:54.319+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:54.326 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:54.324+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:54.698 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:54.695+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:54.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:54.699+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:54.882 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:54.879+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:55.129 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:55.121+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:55.304 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:55.301+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:55.339 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:55.336+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:55.733 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:55.731+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:55.736 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:55.734+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:55.842 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:55.839+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:56.100 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:56.096+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:56.316 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:56.312+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:56.349 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:56.346+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:56.726 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:56.723+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:56.728 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:56.724+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:56.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~221s 2019-11-27T23:33:56.873 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:56.871+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:57.110 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:57.106+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:57.330 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:57.326+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:57.338 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:57.335+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:57.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:57.683+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:57.690 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:57.686+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:57.886 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:57.884+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:58.161 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:58.157+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:58.293 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:58.289+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:58.384 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:58.376+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:58.726 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:58.723+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:58.729 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:58.727+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:58.878 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:58.875+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:33:59.146 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:33:59.142+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:33:59.253 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:33:59.251+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:33:59.438 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:33:59.435+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:33:59.706 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:59.702+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:33:59.707 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:33:59.705+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:33:59.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:33:59.882+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:00.158 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:00.155+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:00.300 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:00.296+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:00.457 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:00.453+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:00.760 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:00.755+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:00.761 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:00.759+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:00.925 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:00.922+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:01.174 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:01.171+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:01.291 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:01.289+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:01.497 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:01.494+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:01.791 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:01.788+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:01.792 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:01.790+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:01.972 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:01.971+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:02.167 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:02.164+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:02.282 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:02.280+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:02.491 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:02.487+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:02.755 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:02.751+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:02.756 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:02.754+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:03.014 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:03.012+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:03.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~227s 2019-11-27T23:34:03.180 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:03.177+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:03.334 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:03.332+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:03.454 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:03.451+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:03.741 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:03.733+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:03.741 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:03.735+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:04.049 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:04.047+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:04.196 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:04.193+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:04.307 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:04.304+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:04.468 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:04.464+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:04.771 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:04.767+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:04.773 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:04.770+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:05.067 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:05.066+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:05.183 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:05.179+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:05.285 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:05.282+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:05.510 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:05.506+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:05.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:05.722+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:05.728 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:05.726+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:06.037 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:34:06.034+0000 1694c700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.856962+0000 front 2019-11-27T23:32:48.660596+0000 (oldest deadline 2019-11-27T23:33:33.700456+0000) 2019-11-27T23:34:06.210 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:34:06.206+0000 1694c700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.765985+0000 front 2019-11-27T23:32:48.983723+0000 (oldest deadline 2019-11-27T23:33:28.835357+0000) 2019-11-27T23:34:06.253 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:06.250+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:06.488 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:06.484+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:06.728 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:34:06.718+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 45sec e238 v238) 2019-11-27T23:34:06.768 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:06.765+0000 1694c700 -1 osd.4 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:48.104174+0000 front 2019-11-27T23:32:49.815085+0000 (oldest deadline 2019-11-27T23:33:31.532433+0000) 2019-11-27T23:34:06.769 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:06.767+0000 1694c700 -1 osd.4 238 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:07.284 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:34:07.283+0000 1694c700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:49.767478+0000 front 2019-11-27T23:32:46.458834+0000 (oldest deadline 2019-11-27T23:33:29.161144+0000) 2019-11-27T23:34:07.485 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:34:07.479+0000 1694c700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:32:47.043568+0000 front 2019-11-27T23:32:47.647906+0000 (oldest deadline 2019-11-27T23:33:30.485770+0000) 2019-11-27T23:34:07.780 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:07.779+0000 1694c700 -1 osd.4 239 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:08.789 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:34:08.788+0000 1694c700 -1 osd.4 240 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126566 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e233) 2019-11-27T23:34:09.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~234s 2019-11-27T23:34:15.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2019-11-27T23:34:22.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~246s 2019-11-27T23:34:28.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~252s 2019-11-27T23:34:30.823 INFO:teuthology.orchestra.run.smithi156.stderr:testIfUnmodifiedSince (test.functional.tests.TestFileComparison) ... ok 2019-11-27T23:34:34.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~259s 2019-11-27T23:34:38.063 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:34:45.538 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.074 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:34:45.549 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.093 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:34:45.569 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.096 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:34:45.573 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.103 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:34:45.579 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.105 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:34:45.582 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.347 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:34:45.822 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.370 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:34:45.846 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:38.371 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:34:45.847 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:34:41.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2019-11-27T23:34:47.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~271s 2019-11-27T23:34:53.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~278s 2019-11-27T23:34:59.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~284s 2019-11-27T23:35:06.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2019-11-27T23:35:12.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2019-11-27T23:35:18.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~303s 2019-11-27T23:35:18.878 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-11-27T23:35:18.878 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-11-27T23:35:28.047 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:28.045+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:29.042 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:29.041+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:30.067 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:30.065+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:31.062 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:31.062+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:32.046 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:32.046+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:32.774 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:32.773+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:33.045 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:33.044+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:33.799 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:33.797+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:34.068 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:34.068+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:34.769 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:34.769+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:35.077 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:35.076+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:35.795 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:35.795+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:36.042 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:36.040+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:36.759 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:36.758+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:37.042 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:37.040+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:37.756 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:37.755+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:38.084 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:38.082+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:38.751 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:38.750+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:39.136 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:39.134+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:39.758 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:39.757+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:40.097 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:40.095+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:40.754 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:40.752+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:41.066 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:41.065+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:41.777 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:41.775+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:42.025 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:42.023+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:42.814 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:42.812+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:42.982 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:42.981+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:43.842 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:43.840+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:44.021 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:44.019+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:44.799 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:44.797+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:45.028 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:45.025+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:45.788 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:45.786+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:46.025 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:46.024+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:46.792 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:46.791+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:47.078 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:47.076+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:47.767 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:47.761+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:48.051 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:48.049+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:48.790 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:48.788+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:49.090 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:49.089+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:49.829 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:49.828+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:50.071 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:50.069+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:50.863 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:50.861+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:51.054 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:51.052+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:51.895 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:51.894+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:52.079 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:52.076+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:52.868 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:52.867+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:53.073 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:53.072+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:53.829 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:53.826+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:54.099 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:54.096+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:54.837 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:54.834+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:55.084 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:55.081+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:55.686 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:35:55.682+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:35:55.837 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:55.836+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:56.060 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:56.059+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:56.678 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:35:56.671+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:35:56.796 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:56.794+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:56.837 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:35:56.834+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:35:56.928 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:35:56.923+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:35:57.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:57.095+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:35:57.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:57.097+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:57.677 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:35:57.674+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:35:57.798 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:57.796+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:57.807 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:35:57.805+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:35:57.908 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:35:57.904+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:35:58.121 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:58.113+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:35:58.121 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:58.116+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:58.660 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:35:58.656+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:35:58.848 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:58.845+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:58.859 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:35:58.856+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:35:58.893 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:35:58.889+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:35:58.950 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:35:58.947+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:35:59.106 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:59.100+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:35:59.106 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:35:59.103+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:35:59.630 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:35:59.626+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:35:59.833 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:35:59.831+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:35:59.861 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:35:59.858+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:35:59.867 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:35:59.866+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:35:59.948 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:35:59.944+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:00.136 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:00.131+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:00.137 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:00.133+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:00.664 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:00.661+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:00.787 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:00.783+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:00.883 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:00.879+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:00.904 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:00.902+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:00.997 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:00.990+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:01.129 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:01.124+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:01.130 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:01.127+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:01.675 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:01.672+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:01.777 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:01.773+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:01.893 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:01.890+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:01.918 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:01.915+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:01.919 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:01.916+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:02.002 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:01.994+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:02.123 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:02.118+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:02.124 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:02.120+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:02.667 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:02.662+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:02.795 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:02.792+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:02.874 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:02.870+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:02.887 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:02.883+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:02.891 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:02.889+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:03.003 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:03.000+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:03.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:03.093+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:03.098 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:03.096+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:03.634 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:03.631+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:03.777 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:03.773+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:03.828 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:03.825+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:03.846 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:03.844+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:03.848 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:03.846+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:03.995 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:03.993+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:04.090 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:04.086+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:04.091 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:04.088+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:04.639 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:04.636+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:04.813 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:04.810+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:04.813 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:04.806+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:04.814 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:04.811+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:04.814 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:04.812+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:05.039 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:05.036+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:05.093 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:05.090+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:05.094 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:05.092+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:05.609 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:05.605+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:05.802 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:05.799+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:05.809 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:05.804+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:05.810 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:05.806+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:05.839 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:05.835+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:06.056 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:06.053+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:06.145 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:06.140+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:06.146 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:06.142+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:06.604 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:06.601+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:06.803 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:06.797+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:06.804 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:06.800+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:06.839 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:06.836+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:06.892 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:06.889+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:07.104 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:07.101+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:07.193 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:07.190+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:07.196 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:07.194+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:07.620 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:07.616+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:07.837 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:07.833+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:07.838 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:07.834+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:07.888 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:07.884+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:07.919 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:07.915+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:08.146 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:08.138+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:08.227 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:08.224+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:08.229 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:08.227+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:08.627 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:08.624+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:08.844 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:08.839+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:08.874 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:08.871+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:08.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:08.881+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:08.885 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:08.882+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:09.150 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:09.146+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:09.221 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:09.216+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:09.222 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:09.219+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:09.590 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:09.585+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:09.851 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:09.848+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:09.852 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:09.849+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:09.888 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:09.884+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:09.919 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:09.916+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:10.175 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:10.171+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:10.240 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:10.235+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:10.241 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:10.238+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:10.580 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:10.577+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:10.812 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:10.809+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:10.815 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:10.813+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:10.853 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:10.849+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:10.945 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:10.941+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:11.189 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:11.185+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:11.280 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:11.277+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:11.283 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:11.281+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:11.538 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:11.534+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:11.831 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:11.826+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:11.831 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:11.828+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:11.887 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:11.884+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:11.934 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:11.931+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:12.145 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:12.141+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:12.290 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:12.285+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:12.291 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:12.288+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:12.494 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:12.490+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:12.828 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:12.824+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:12.829 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:12.826+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:12.904 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:12.900+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:12.930 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:12.926+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:13.153 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:13.150+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:13.327 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:13.322+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:13.328 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:13.324+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:13.498 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:13.495+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:13.862 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:13.860+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:13.883 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:13.878+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:13.884 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:13.880+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:13.954 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:13.951+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:14.159 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:14.156+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:14.326 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:14.321+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:14.327 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:14.323+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:14.515 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:14.511+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:14.859 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:14.855+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:14.929 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:14.925+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:14.930 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:14.927+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:14.975 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:14.971+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:15.151 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:15.147+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:15.287 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:15.282+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:15.288 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:15.285+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:15.485 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:15.482+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:15.869 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:15.866+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:15.946 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:15.943+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:15.977 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:15.973+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:15.977 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:15.974+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:16.125 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:16.122+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:16.283 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:16.278+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:16.285 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:16.281+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:16.444 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:16.441+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:16.915 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:16.912+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:16.958 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:16.954+0000 1694c700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.082634+0000 front 2019-11-27T23:35:16.637875+0000 (oldest deadline 2019-11-27T23:36:01.821445+0000) 2019-11-27T23:36:16.958 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:16.953+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:16.959 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:16.957+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:17.136 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:17.133+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:17.323 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:17.320+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:17.325 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:17.323+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:17.470 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:17.466+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:17.927 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:17.923+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:17.965 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:17.962+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:17.968 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:17.965+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:18.172 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:18.168+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:18.305 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:18.302+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:18.309 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:18.307+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:18.497 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:18.494+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:18.971 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:18.967+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:18.978 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:18.974+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:19.004 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:19.002+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:19.225 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:19.221+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:19.300 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:19.294+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:19.301 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:19.298+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:19.550 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:19.546+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:19.934 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:19.931+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:19.965 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:19.962+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:19.994 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:19.991+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:20.196 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:20.193+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:20.330 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:20.323+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:20.330 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:20.326+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:20.532 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:20.528+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:20.947 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:20.943+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:20.954 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:20.951+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:20.984 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:20.981+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:21.211 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:21.207+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:21.308 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:21.304+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:21.309 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:21.306+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:21.537 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:21.534+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:21.931 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:21.928+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:21.969 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:21.967+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:21.973 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:21.970+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:22.262 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:22.255+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:22.276 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:22.272+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:22.277 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:22.274+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:22.566 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:22.563+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:22.937 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:22.934+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:22.959 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:22.956+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:23.000 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:22.996+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:23.235 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:23.231+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:23.236 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:23.233+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:23.260 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:23.256+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:23.531 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:23.527+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:23.918 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:23.914+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:23.955 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:23.951+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:24.003 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:24.001+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:24.215 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:24.213+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:24.255 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:24.251+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:24.256 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:24.253+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:24.565 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:24.561+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:24.900 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:24.897+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:24.952 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:24.950+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:24.964 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:24.962+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:25.210 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:25.205+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:25.211 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:25.207+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:25.268 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:25.264+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:25.558 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:25.555+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:25.936 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:25.932+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:25.942 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:25.939+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:25.972 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:25.970+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:26.226 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:26.223+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:26.229 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:26.224+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:26.231 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:26.227+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:26.552 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:26.549+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:26.952 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:26.951+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:26.979 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:26.976+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:27.008 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:27.006+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:27.211 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:27.206+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:27.213 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:27.210+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:27.217 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:27.213+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:27.251 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:36:27.249+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e245 v245) 2019-11-27T23:36:27.509 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:27.506+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:27.934 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:27.931+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:28.006 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:28.004+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:28.022 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:28.018+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:28.232 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:28.229+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:28.265 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:28.261+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:28.268 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:28.264+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:28.510 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:28.507+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:28.978 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:28.974+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:28.978 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:28.976+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:29.016 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:29.012+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:29.233 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:29.229+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:29.235 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:29.232+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:29.259 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:29.253+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:29.562 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:29.558+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:29.948 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:29.947+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:30.023 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:30.023+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:30.031 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:30.028+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:30.217 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:30.213+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:30.268 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:30.264+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:30.269 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:30.267+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:30.544 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:30.541+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:30.974 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:30.972+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:30.987 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:30.986+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:31.027 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:31.024+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:31.243 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:31.240+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:31.284 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:31.279+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:31.285 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:31.282+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:31.574 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:31.571+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:31.930 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:31.927+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:31.957 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:31.950+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:32.016 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:32.012+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:32.271 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:36:32.269+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e245 v245) 2019-11-27T23:36:32.293 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:32.289+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:32.335 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:32.332+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:32.338 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:32.336+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:32.574 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:32.571+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:32.911 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:32.909+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:32.962 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:32.960+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:33.048 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:33.045+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:33.250 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:33.247+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:33.299 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:33.292+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:33.300 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:33.298+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:33.576 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:33.573+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:33.906 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:33.904+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:33.944 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:33.941+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:34.050 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:34.048+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:34.230 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:34.226+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:34.285 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:34.282+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:34.287 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:34.284+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:34.611 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:34.608+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:34.925 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:34.924+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:34.935 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:34.933+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:35.101 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:35.097+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:35.256 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:35.252+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:35.303 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:35.297+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:35.305 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:35.301+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:35.622 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:35.619+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:35.913 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:35.911+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:35.976 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:35.974+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:36.074 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:36.070+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:36.279 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:36.275+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:36.281 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:36.278+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:36.303 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:36.299+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:36.643 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:36.638+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:36.877 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:36.875+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:37.001 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:36.995+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:37.117 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:36:37.114+0000 1694c700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:17.622796+0000 front 2019-11-27T23:35:15.884951+0000 (oldest deadline 2019-11-27T23:35:57.934857+0000) 2019-11-27T23:36:37.281 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:36:37.278+0000 1694c700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.513828+0000 front 2019-11-27T23:35:13.784698+0000 (oldest deadline 2019-11-27T23:35:56.918381+0000) 2019-11-27T23:36:37.333 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:37.329+0000 1694c700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:14.826931+0000 front 2019-11-27T23:35:14.528896+0000 (oldest deadline 2019-11-27T23:35:56.801353+0000) 2019-11-27T23:36:37.334 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:37.332+0000 1694c700 -1 osd.4 245 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:37.343 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:36:37.341+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 42sec e245 v245) 2019-11-27T23:36:37.654 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:37.651+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:37.847 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:37.845+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:37.995 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:37.994+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:38.312 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:38.310+0000 1694c700 -1 osd.4 246 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e243) 2019-11-27T23:36:38.618 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:36:38.615+0000 1694c700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:15.896204+0000 front 2019-11-27T23:35:13.787621+0000 (oldest deadline 2019-11-27T23:35:55.633711+0000) 2019-11-27T23:36:38.809 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:36:38.807+0000 1694c700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:35:13.518778+0000 front 2019-11-27T23:35:16.554011+0000 (oldest deadline 2019-11-27T23:35:56.384700+0000) 2019-11-27T23:36:38.960 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:38.958+0000 1694c700 -1 osd.6 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:39.483 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:36:39.413+0000 1694c700 -1 osd.4 247 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:126926 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 440514352 gen 3] snapc 0=[] ondisk+write+known_if_redirected e243) 2019-11-27T23:36:39.958 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:36:39.951+0000 1694c700 -1 osd.6 247 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:126936 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e245) 2019-11-27T23:36:52.834 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:37:00.309 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:52.875 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:37:00.350 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:52.941 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:37:00.417 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.219 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:37:00.554 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.219 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:37:00.428 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.220 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:37:00.431 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.220 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:37:00.670 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.220 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:37:00.448 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:36:53.220 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:37:00.633 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:37:49.505 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:49.503+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:50.493 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:50.485+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:50.512 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:50.509+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:51.513 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:51.511+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:51.525 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:51.524+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:52.483 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:52.481+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:52.532 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:52.531+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:53.533 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:53.532+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:53.562 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:53.560+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:54.558 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:54.556+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:54.588 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:54.587+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:55.552 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:55.550+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:55.566 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:55.565+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:56.522 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:56.520+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:56.531 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:56.529+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:57.486 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:57.484+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:57.521 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:57.520+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:58.501 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:58.499+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:58.512 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:58.510+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:59.486 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:37:59.485+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:37:59.505 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:37:59.499+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:00.483 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:00.482+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:00.514 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:00.512+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:01.472 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:01.470+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:01.495 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:01.492+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:02.461 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:02.460+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:02.515 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:02.513+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:03.509 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:03.507+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:03.514 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:03.513+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:04.474 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:04.472+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:04.562 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:04.560+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:05.524 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:05.523+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:05.578 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:05.568+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:06.537 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:06.535+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:06.614 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:06.613+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:07.547 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:07.545+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:07.633 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:07.631+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:08.504 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:08.503+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:08.606 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:08.604+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:09.535 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:09.534+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:09.580 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:09.578+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:10.552 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:10.550+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:10.630 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:10.628+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:11.514 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:11.513+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:11.658 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:11.657+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:12.474 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:12.473+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:12.691 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:12.689+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:13.446 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:13.444+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:13.677 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:13.675+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:14.433 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:14.432+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:14.674 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:14.673+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:15.411 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:15.409+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:15.698 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:15.697+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:16.368 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:16.366+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:16.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:16.722+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:17.356 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:17.354+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:17.704 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:17.702+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:18.361 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:18.344+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:18.363 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:18.362+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:18.701 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:18.700+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:19.121 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:19.117+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:19.320 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:19.317+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:19.320 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:19.318+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:19.344 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:19.341+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:19.730 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:19.729+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:20.122 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:20.118+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:20.257 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:20.255+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:20.322 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:20.319+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:20.323 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:20.321+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:20.343 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:20.340+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:20.572 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:20.568+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:20.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:20.723+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:21.109 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:21.105+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:21.243 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:21.240+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:21.369 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:21.364+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:21.370 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:21.368+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:21.396 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:21.392+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:21.603 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:21.600+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:21.730 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:21.726+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:21.736 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:21.730+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:22.150 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:22.146+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:22.204 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:22.202+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:22.414 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:22.410+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:22.414 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:22.413+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:22.442 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:22.438+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:22.615 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:22.612+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:22.786 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:22.781+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:22.787 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:22.784+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:23.169 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:23.165+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:23.252 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:23.250+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:23.421 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:23.418+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:23.450 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:23.448+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:23.452 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:23.449+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:23.632 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:38:31.107 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.644 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:38:31.119 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.657 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:23.653+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:23.658 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:38:31.134 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.662 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:38:31.137 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.664 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:38:31.140 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.666 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:38:31.141 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.780 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:23.778+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:23.783 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:23.781+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:23.783 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:38:31.260 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.814 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:38:31.290 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:23.818 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:38:31.293 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:38:24.179 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:24.177+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:24.285 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:24.283+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:24.388 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:24.385+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:24.488 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:24.486+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:24.489 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:24.488+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:24.627 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:24.624+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:24.808 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:24.806+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:24.810 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:24.807+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:25.182 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:25.179+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:25.273 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:25.271+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:25.428 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:25.425+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:25.498 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:25.497+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:25.499 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:25.499+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:25.659 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:25.655+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:25.824 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:25.821+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:25.824 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:25.823+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:26.203 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:26.199+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:26.314 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:26.312+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:26.415 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:26.412+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:26.543 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:26.541+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:26.543 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:26.541+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:26.710 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:26.707+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:26.874 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:26.872+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:26.879 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:26.877+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:27.233 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:27.229+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:27.277 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:27.275+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:27.448 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:27.444+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:27.531 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:27.528+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:27.531 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:27.530+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:27.753 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:27.746+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:27.856 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:27.854+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:27.857 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:27.855+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:28.264 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:28.257+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:28.327 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:28.323+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:28.430 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:28.420+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:28.573 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:28.571+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:28.575 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:28.573+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:28.799 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:28.795+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:28.813 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:28.810+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:28.819 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:28.815+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:29.258 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:29.254+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:29.329 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:29.326+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:29.438 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:29.429+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:29.609 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:29.604+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:29.609 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:29.605+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:29.758 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:29.755+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:29.784 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:29.780+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:29.793 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:29.784+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:30.215 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:30.211+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:30.311 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:30.308+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:30.451 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:30.448+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:30.588 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:30.582+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:30.597 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:30.591+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:30.783 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:30.778+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:30.806 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:30.802+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:30.807 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:30.804+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:31.169 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:31.165+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:31.340 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:31.336+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:31.477 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:31.468+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:31.623 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:31.619+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:31.624 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:31.621+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:31.738 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:31.736+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:31.776 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:31.772+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:31.781 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:31.778+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:32.139 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:32.136+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:32.307 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:32.303+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:32.441 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:32.438+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:32.616 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:32.613+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:32.617 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:32.614+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:32.770 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:32.766+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:32.823 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:32.819+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:32.824 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:32.821+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:33.114 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:33.111+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:33.268 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:33.265+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:33.434 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:33.431+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:33.571 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:33.568+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:33.577 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:33.571+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:33.780 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:33.775+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:33.867 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:33.864+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:33.873 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:33.869+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:34.073 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:34.069+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:34.306 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:34.303+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:34.457 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:34.454+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:34.558 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:34.555+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:34.559 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:34.557+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:34.809 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:34.805+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:34.872 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:34.867+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:34.873 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:34.870+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:35.063 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:35.060+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:35.282 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:35.278+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:35.458 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:35.454+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:35.605 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:35.602+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:35.605 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:35.603+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:35.786 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:35.782+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:35.874 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:35.868+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:35.875 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:35.871+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:36.032 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:36.029+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:36.329 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:36.326+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:36.452 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:36.449+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:36.590 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:36.588+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:36.593 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:36.590+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:36.835 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:36.831+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:36.905 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:36.901+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:36.909 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:36.906+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:37.035 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:37.032+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:37.377 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:37.373+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:37.490 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:37.487+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:37.591 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:37.587+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:37.591 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:37.589+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:37.840 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:37.837+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:37.872 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:37.869+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:37.876 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:37.874+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:38.020 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:38.017+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:38.396 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:38.393+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:38.539 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:38.536+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:38.630 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:38.627+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:38.631 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:38.629+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:38.832 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:38.829+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:38.835 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:38.833+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:38.860 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:38.857+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:39.002 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:38.998+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:39.433 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:39.430+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:39.500 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:39.497+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:39.606 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:39.603+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:39.607 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:39.604+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:39.849 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:39.845+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:39.851 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:39.847+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:39.882 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:39.878+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:40.011 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:40.008+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:40.415 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:40.412+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:40.537 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:40.533+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:40.635 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:40.631+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:40.638 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:40.635+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:40.883 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:40.879+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:40.885 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:40.881+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:40.911 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:40.908+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:41.023 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:41.019+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:41.400 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:41.397+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:41.500 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:41.496+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:41.660 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:41.658+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:41.661 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:41.660+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:41.917 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:41.912+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:41.917 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:41.911+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:41.918 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:41.915+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:42.051 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:42.047+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:42.418 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:42.414+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:42.471 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:42.467+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:42.697 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:42.694+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:42.698 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:42.694+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:42.920 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:42.915+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:42.922 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:42.918+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:42.944 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:42.941+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:43.005 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:43.002+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:43.420 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:43.416+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:43.462 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:43.459+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:43.679 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:43.675+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:43.679 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:43.676+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:43.951 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:43.945+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:43.953 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:43.948+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:43.964 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:43.960+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:43.990 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:43.986+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:44.429 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:44.426+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:44.461 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:44.449+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:44.646 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:44.644+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:44.647 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:44.645+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:44.959 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:44.955+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:44.959 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:44.955+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:44.964 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:44.959+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:45.007 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:45.004+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:45.460 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:45.457+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:45.504 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:45.501+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:45.678 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:45.675+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:45.679 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:45.676+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:45.978 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:45.973+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:45.981 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:45.976+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:46.002 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:45.999+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:46.021 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:46.019+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:46.454 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:46.451+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:46.543 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:46.540+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:46.649 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:46.646+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:46.650 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:46.647+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:46.965 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:46.962+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:46.968 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:46.966+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:47.000 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:46.998+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:47.074 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:47.070+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:47.496 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:47.492+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:47.549 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:47.546+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:47.633 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:47.630+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:47.633 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:47.631+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:47.962 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:47.958+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:47.988 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:47.982+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:47.989 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:47.985+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:48.088 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:48.084+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:48.472 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:48.469+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:48.520 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:48.516+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:48.646 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:48.643+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:48.649 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:48.646+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:48.917 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:48.915+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:49.029 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:49.025+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:49.034 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:49.031+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:49.116 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:49.114+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:49.501 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:49.495+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:49.556 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:49.553+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:49.610 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:49.606+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:49.610 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:49.608+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:49.950 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:49.947+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:50.034 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:50.030+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:50.035 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:50.032+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:50.117 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:50.115+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:50.477 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:50.474+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:50.572 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:50.568+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:50.648 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:50.645+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:50.649 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:50.646+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:50.910 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:50.907+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:51.072 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:51.067+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:51.073 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:51.070+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:51.151 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:51.148+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:51.480 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:51.478+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:51.605 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:51.602+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:51.638 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:51.635+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:51.638 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:51.636+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:51.877 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:51.874+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:52.106 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:52.102+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:52.119 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:52.113+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:52.121 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:52.117+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:52.477 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:52.474+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:52.567 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:52.564+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:52.658 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:52.655+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:52.659 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:52.657+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:52.873 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:52.869+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:53.122 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:53.118+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:53.155 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:53.149+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:53.157 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:53.152+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:53.222 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:38:53.220+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 45sec e252 v252) 2019-11-27T23:38:53.508 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:53.505+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:53.599 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:53.597+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:53.670 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:53.667+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:53.671 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:53.668+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:53.890 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:53.887+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:54.124 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:54.121+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:54.129 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:54.126+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:54.157 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:54.154+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:54.508 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:54.505+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:54.605 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:54.602+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:54.650 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:54.642+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:54.650 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:54.644+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:54.941 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:54.938+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:55.115 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:55.110+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:55.116 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:55.113+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:55.210 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:55.206+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:55.505 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:55.501+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:55.563 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:55.561+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:55.688 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:55.686+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:55.689 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:55.687+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:55.939 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:55.935+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:56.128 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:56.124+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:56.130 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:56.127+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:56.237 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:56.234+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:56.518 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:56.512+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:56.572 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:56.570+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:56.648 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:56.645+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:56.649 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:56.647+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:56.906 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:56.903+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:57.163 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:57.158+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:57.165 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:57.161+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:57.255 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:57.251+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:57.496 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:38:57.493+0000 1694c700 -1 osd.0 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:32.943499+0000 front 2019-11-27T23:37:32.941039+0000 (oldest deadline 2019-11-27T23:38:17.522247+0000) 2019-11-27T23:38:57.583 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:57.581+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:57.698 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:57.697+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:57.700 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:57.699+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:57.861 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:38:57.858+0000 1694c700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:37.510795+0000 front 2019-11-27T23:37:36.854275+0000 (oldest deadline 2019-11-27T23:38:20.326916+0000) 2019-11-27T23:38:58.160 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:58.156+0000 1694c700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.565206+0000 front 2019-11-27T23:37:35.556317+0000 (oldest deadline 2019-11-27T23:38:21.299496+0000) 2019-11-27T23:38:58.161 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:58.159+0000 1694c700 -1 osd.4 252 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:58.267 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:38:58.263+0000 1694c700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:34.670324+0000 front 2019-11-27T23:37:34.306577+0000 (oldest deadline 2019-11-27T23:38:18.374926+0000) 2019-11-27T23:38:58.296 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:38:58.289+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 45sec e252 v252) 2019-11-27T23:38:58.631 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:38:58.628+0000 1694c700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.695650+0000 front 2019-11-27T23:37:35.684512+0000 (oldest deadline 2019-11-27T23:38:19.776453+0000) 2019-11-27T23:38:58.687 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:58.686+0000 1694c700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:37:35.505519+0000 front 2019-11-27T23:37:35.500774+0000 (oldest deadline 2019-11-27T23:38:19.243439+0000) 2019-11-27T23:38:58.689 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:58.688+0000 1694c700 -1 osd.6 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:59.251 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:38:59.249+0000 1694c700 -1 osd.4 253 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:38:59.664 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:38:59.663+0000 1694c700 -1 osd.6 253 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127199 3.36 3.813517b6 (undecoded) ondisk+write+known_if_redirected e250) 2019-11-27T23:39:00.431 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:39:00.366+0000 1694c700 -1 osd.4 254 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127190 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 440514352 gen 5] snapc 0=[] ondisk+write+known_if_redirected e250) 2019-11-27T23:39:43.622 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:39:51.096 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.655 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:39:51.129 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.662 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:39:51.138 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.663 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:39:51.139 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.671 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:39:51.147 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.696 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:39:51.172 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.775 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:39:51.251 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.789 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:39:51.264 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:39:43.798 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:39:51.274 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:40:13.055 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:13.054+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:14.087 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:14.085+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:15.088 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:15.086+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:16.108 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:16.106+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:17.157 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:17.155+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:18.174 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:18.165+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:19.191 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:19.189+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:20.218 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:20.216+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:21.198 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:21.196+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:22.247 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:22.245+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:23.237 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:23.235+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:24.200 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:24.198+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:25.210 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:25.208+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:26.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:26.166+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:27.135 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:27.133+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:28.121 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:28.119+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:29.130 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:29.128+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:30.146 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:30.144+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:31.187 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:31.184+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:32.168 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:32.166+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:33.160 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:33.158+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:34.127 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:34.125+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:35.123 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:35.121+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:36.174 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:36.172+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:37.196 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:37.195+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:38.230 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:38.228+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:39.270 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:39.266+0000 1694c700 -1 osd.4 257 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:40.438 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:40.342+0000 1694c700 -1 osd.4 259 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:41.389 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:41.376+0000 1694c700 -1 osd.4 260 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:42.601 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:42.445+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:42.631 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:42.446+0000 1694c700 -1 osd.4 260 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:42.861 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:42.778+0000 1694c700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:43.497 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:43.413+0000 1694c700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:43.598 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:43.594+0000 1694c700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:43.690 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:43.613+0000 1694c700 -1 osd.4 261 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:43.992 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:43.990+0000 1694c700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:43.993 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:43.978+0000 1694c700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:44.563 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:44.561+0000 1694c700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:44.573 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:44.570+0000 1694c700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:44.639 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:44.636+0000 1694c700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:44.639 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:44.638+0000 1694c700 -1 osd.4 262 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:44.967 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:44.966+0000 1694c700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:44.972 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:44.967+0000 1694c700 -1 osd.3 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:45.559 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:45.557+0000 1694c700 -1 osd.1 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:45.601 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:45.599+0000 1694c700 -1 osd.7 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:45.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:45.687+0000 1694c700 -1 osd.4 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:45.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:45.688+0000 1694c700 -1 osd.4 262 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:45.959 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:45.958+0000 1694c700 -1 osd.6 262 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:46.097 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:46.042+0000 1694c700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:46.228 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:46.225+0000 1694c700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:46.599 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:46.595+0000 1694c700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:46.710 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:46.706+0000 1694c700 -1 osd.4 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:46.711 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:46.708+0000 1694c700 -1 osd.4 263 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:46.751 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:46.723+0000 1694c700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:46.962 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:46.960+0000 1694c700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:47.109 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:47.097+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:47.271 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:47.267+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:47.596 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:47.593+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:47.725 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:47.722+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:47.725 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:47.724+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:47.743 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:47.740+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:48.001 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:48.000+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:48.147 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:48.143+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:48.239 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:48.235+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:48.618 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:48.615+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:48.708 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:48.705+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:48.778 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:48.775+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:48.779 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:48.777+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:48.982 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:48.981+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:49.132 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:49.128+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:49.205 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:49.202+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:49.611 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:49.607+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:49.688 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:49.686+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:49.779 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:49.775+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:49.781 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:49.778+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:49.983 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:49.980+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:50.172 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:50.169+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:50.176 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:50.173+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:50.563 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:50.560+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:50.657 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:50.654+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:50.735 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:50.733+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:50.736 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:50.734+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:50.961 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:50.959+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:51.201 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:51.198+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:51.202 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:51.199+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:51.537 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:51.534+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:51.664 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:51.662+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:51.719 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:51.713+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:51.721 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:51.714+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:51.962 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:51.960+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:52.178 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:52.174+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:52.218 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:52.212+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:52.524 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:52.521+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:52.682 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:52.679+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:52.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:52.742+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:52.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:52.744+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:52.937 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:52.935+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:53.225 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:53.221+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:53.230 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:53.226+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:53.527 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:53.523+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:53.700 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:53.699+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:53.772 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:53.768+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:53.772 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:53.771+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:53.960 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:53.958+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:54.210 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:54.206+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:54.292 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:54.273+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:54.530 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:54.526+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:54.720 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:54.718+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:54.760 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:54.758+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:54.762 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:54.759+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:54.959 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:54.957+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:55.171 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:55.169+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:55.327 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:55.324+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:55.555 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:55.553+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:55.722 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:55.719+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:55.780 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:55.773+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:55.781 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:55.777+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:55.932 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:55.930+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:56.129 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:56.126+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:56.282 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:56.279+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:56.523 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:56.520+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:56.709 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:56.706+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:56.803 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:56.799+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:56.803 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:56.801+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:56.966 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:56.963+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:57.111 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:57.109+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:57.279 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:57.277+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:57.514 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:57.511+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:57.699 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:57.696+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:57.779 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:57.774+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:57.780 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:57.776+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:57.931 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:57.928+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:58.067 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:58.063+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:testIfMatch (test.functional.tests.TestFileComparisonUTF8) ... ok 2019-11-27T23:40:58.356 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:58.351+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:58.485 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:58.482+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:58.696 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:58.693+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:58.815 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:58.813+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:58.820 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:58.817+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:58.889 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:58.887+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:40:59.102 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:40:59.098+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:40:59.358 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:40:59.354+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:40:59.441 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:40:59.437+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:40:59.663 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:40:59.659+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:40:59.788 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:59.783+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:40:59.789 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:40:59.786+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:40:59.932 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:40:59.929+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:00.099 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:00.095+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:00.336 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:00.332+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:41:00.436 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:00.432+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:00.657 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:00.653+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:00.748 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:00.743+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:00.750 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:00.746+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:00.911 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:00.907+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:01.150 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:01.146+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:01.304 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:01.301+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:41:01.456 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:01.454+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:01.691 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:01.688+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:01.797 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:01.794+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:01.798 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:01.795+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:01.920 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:01.916+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:02.124 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:02.120+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:02.261 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:02.258+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:41:02.475 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:02.470+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:02.700 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:02.696+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:02.840 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:02.834+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:02.841 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:02.837+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:02.910 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:02.906+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:03.089 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:03.085+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:03.291 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:03.288+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:41:03.494 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:03.490+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:03.666 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:03.662+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:03.813 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:03.808+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:03.814 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:03.811+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:03.936 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:03.933+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:04.052 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:04.048+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:04.279 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:04.275+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.498853+0000 front 2019-11-27T23:40:00.868226+0000 (oldest deadline 2019-11-27T23:40:45.444724+0000) 2019-11-27T23:41:04.543 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:04.539+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:04.652 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:04.647+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:04.796 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:04.792+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:04.796 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:04.794+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:04.964 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:04.961+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:05.052 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:05.049+0000 1694c700 -1 osd.3 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:05.524 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:05.521+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:05.664 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:05.661+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:05.830 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:05.826+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:05.831 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:05.828+0000 1694c700 -1 osd.4 264 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:06.008 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:06.005+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:06.158 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:06.044+0000 1694c700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:06.534 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:06.531+0000 1694c700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:06.702 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:06.695+0000 1694c700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:06.798 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:06.794+0000 1694c700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:06.799 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:06.796+0000 1694c700 -1 osd.4 265 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:07.020 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:07.018+0000 1694c700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:07.066 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:07.036+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:07.640 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:07.602+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:07.680 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:07.677+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:07.772 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:07.767+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:07.774 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:07.770+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:08.031 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:08.028+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:08.074 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:08.070+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:08.590 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:08.586+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:08.700 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:08.697+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:08.814 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:08.809+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:08.815 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:08.812+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:09.010 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:09.006+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:09.121 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:09.118+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:09.552 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:09.548+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:09.675 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:09.672+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:09.794 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:09.789+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:09.796 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:09.792+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:10.028 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:10.024+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:10.112 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:10.109+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:10.524 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:10.521+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:10.694 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:10.668+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:10.797 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:10.793+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:10.799 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:10.795+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:11.005 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:11.000+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:11.150 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:11.147+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:11.511 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:11.507+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:11.680 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:11.677+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:11.762 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:11.758+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:11.763 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:11.760+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:12.035 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:12.031+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:12.158 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:12.154+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:12.493 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:12.488+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:12.679 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:12.676+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:12.788 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:12.784+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:12.791 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:12.788+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:12.993 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:12.989+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:13.165 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:13.160+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:13.483 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:13.480+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:13.674 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:13.671+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:13.749 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:13.744+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:13.750 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:13.748+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:14.003 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:13.999+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:14.213 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:14.209+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:14.447 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:14.444+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:14.643 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:14.639+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:14.745 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:14.741+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:14.746 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:14.743+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:15.037 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:15.034+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:15.213 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:15.209+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:15.459 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:15.455+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:15.663 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:15.659+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:15.794 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:15.789+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:15.794 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:15.792+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:15.998 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:15.995+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:16.210 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:16.206+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:16.459 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:16.455+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:16.647 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:16.643+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:16.766 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:16.764+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:16.770 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:16.767+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:16.974 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:16.971+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:17.260 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:17.256+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:17.501 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:17.497+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:17.634 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:17.631+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:17.757 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:17.754+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:17.759 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:17.757+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:17.983 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:17.979+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:18.296 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:18.292+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:18.489 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:18.485+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:18.609 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:18.605+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:18.797 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:18.794+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:18.803 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:18.799+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:18.989 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:41:18.984+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 45sec e262 v262) 2019-11-27T23:41:19.009 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:19.006+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:19.331 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:19.327+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:19.540 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:19.535+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:19.604 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:19.600+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:19.810 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:19.804+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:19.811 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:19.808+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:20.035 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:20.028+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:20.345 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:20.342+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:20.550 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:20.546+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:20.624 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:20.620+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:20.829 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:20.817+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:20.831 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:20.822+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:21.062 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:21.059+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:21.398 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:21.395+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:21.567 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:21.563+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:21.645 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:21.642+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:21.830 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:21.826+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:21.831 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:21.828+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:22.042 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:22.039+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:22.372 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:22.368+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:22.600 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:22.592+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:22.614 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:22.611+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:22.805 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:22.801+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:22.807 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:22.803+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:23.003 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:23.000+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:23.386 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:41:23.384+0000 1694c700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:57.380881+0000 front 2019-11-27T23:39:58.976463+0000 (oldest deadline 2019-11-27T23:40:42.023751+0000) 2019-11-27T23:41:23.575 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:41:23.572+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.021413+0000 front 2019-11-27T23:40:00.004044+0000 (oldest deadline 2019-11-27T23:40:44.034787+0000) 2019-11-27T23:41:23.631 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:23.627+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:23.773 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:23.769+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.084209+0000 front 2019-11-27T23:40:01.850103+0000 (oldest deadline 2019-11-27T23:40:41.816653+0000) 2019-11-27T23:41:23.774 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:23.773+0000 1694c700 -1 osd.4 266 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:23.982 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:41:23.979+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:40:00.025439+0000 front 2019-11-27T23:39:59.769181+0000 (oldest deadline 2019-11-27T23:40:43.735048+0000) 2019-11-27T23:41:24.070 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:41:24.067+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 45sec e262 v262) 2019-11-27T23:41:24.610 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:41:24.607+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:39:59.277406+0000 front 2019-11-27T23:39:59.278758+0000 (oldest deadline 2019-11-27T23:40:42.683431+0000) 2019-11-27T23:41:24.811 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:24.732+0000 1694c700 -1 osd.4 267 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:25.750 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:25.706+0000 1694c700 -1 osd.4 268 get_health_metrics reporting 15 slow ops, oldest is osd_op(client.4537.0:127501 5.e 5.f8c99aee (undecoded) ondisk+write+known_if_redirected e256) 2019-11-27T23:41:49.306 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:41:56.780 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.318 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:41:56.792 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.329 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:41:56.803 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.329 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:41:56.804 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.337 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:41:56.808 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.337 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:41:56.808 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.539 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:41:57.013 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.540 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:41:57.016 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:49.550 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:41:57.026 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:41:54.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:54.746+0000 1694c700 -1 osd.4 281 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:127855 5.f 5:f95f44c2:::notify.0:head [watch reconnect cookie 820964128 gen 72] snapc 0=[] ondisk+write+known_if_redirected e267) 2019-11-27T23:41:55.201 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:55.187+0000 1694c700 -1 osd.0 281 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:41:55.745 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:41:55.744+0000 1694c700 -1 osd.4 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:127855 5.f 5:f95f44c2:::notify.0:head [watch reconnect cookie 820964128 gen 72] snapc 0=[] ondisk+write+known_if_redirected e267) 2019-11-27T23:41:56.190 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:56.187+0000 1694c700 -1 osd.0 282 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:41:57.199 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:57.196+0000 1694c700 -1 osd.0 282 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:41:58.215 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:58.213+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:41:59.193 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:41:59.191+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:00.223 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:00.221+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:01.185 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:01.183+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:02.167 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:02.165+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:03.192 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:03.189+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:04.208 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:04.205+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:05.170 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:05.167+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:06.131 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:06.128+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:07.110 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:07.107+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:08.149 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:08.146+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:09.150 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:09.147+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:10.116 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:10.113+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:11.090 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:11.087+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:11.475 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:42:11.397+0000 1694c700 -1 osd.5 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:138830 7.e 7.68795c0e (undecoded) ondisk+retry+write+known_if_redirected e256) 2019-11-27T23:42:12.094 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:12.091+0000 1694c700 -1 osd.0 283 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:13.223 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:13.221+0000 1694c700 -1 osd.0 284 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:14.305 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:14.197+0000 1694c700 -1 osd.0 286 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:15.199 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:15.197+0000 1694c700 -1 osd.0 287 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:16.179 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:16.176+0000 1694c700 -1 osd.0 287 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:16.509 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:42:16.495+0000 3778f700 -1 osd.5 287 build_incremental_map_msg missing incremental map 286 2019-11-27T23:42:17.144 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:17.138+0000 1694c700 -1 osd.0 289 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:17.753 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:42:17.729+0000 3678d700 -1 osd.5 288 build_incremental_map_msg missing incremental map 286 2019-11-27T23:42:18.130 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:18.127+0000 1694c700 -1 osd.0 289 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:19.159 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:19.155+0000 1694c700 -1 osd.0 289 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:19.970 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:42:19.766+0000 38791700 -1 osd.5 289 build_incremental_map_msg missing incremental map 286 2019-11-27T23:42:20.198 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:20.195+0000 1694c700 -1 osd.0 289 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:21.200 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:21.172+0000 1694c700 -1 osd.0 290 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:22.251 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:42:22.193+0000 1694c700 -1 osd.0 290 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4546.0:138824 7.e 7.ff44e12e (undecoded) ondisk+retry+read+known_if_redirected e267) 2019-11-27T23:42:45.568 INFO:teuthology.orchestra.run.smithi156.stderr:testIfMatchAndUnmodified (test.functional.tests.TestFileComparisonUTF8) ... ok 2019-11-27T23:43:19.188 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:19.176+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:19.223 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:19.219+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:19.433 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:19.431+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:19.515 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:19.512+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:20.228 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:20.225+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:20.273 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:20.270+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:20.409 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:20.406+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:20.540 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:20.539+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:21.218 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:21.215+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:21.263 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:21.261+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:21.373 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:21.370+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:21.546 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:21.544+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:22.247 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:22.242+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:22.263 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:22.261+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:22.368 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:22.365+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:22.545 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:22.543+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:23.234 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:23.231+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:23.286 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:23.284+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:23.292 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:23.290+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:23.330 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:23.327+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:23.527 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:23.524+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:24.234 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:24.230+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:24.255 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:24.253+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:24.337 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:24.334+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:24.351 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:24.349+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:24.574 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:24.571+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:24.575 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:24.573+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:24.653 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:24.649+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:testIfModifiedSince (test.functional.tests.TestFileComparisonUTF8) ... ok 2019-11-27T23:43:25.209 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:25.205+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:25.224 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:25.220+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:25.313 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:25.309+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:25.382 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:25.378+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:25.567 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:25.563+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:25.568 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:25.564+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:25.662 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:25.659+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:26.234 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:26.230+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:26.244 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:26.240+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:26.361 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:26.356+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:26.384 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:26.380+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:26.609 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:26.606+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:26.610 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:26.609+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:26.688 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:26.674+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:27.258 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:27.254+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:27.259 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:27.255+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:27.348 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:27.344+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:27.360 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:27.357+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:27.651 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:27.647+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:27.651 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:27.649+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:27.731 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:27.728+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:28.275 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:28.272+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:28.303 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:28.299+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:28.308 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:28.302+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:28.360 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:28.356+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:28.674 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:28.670+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:28.675 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:28.671+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:28.783 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:28.779+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:29.281 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:29.277+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:29.296 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:29.293+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:29.330 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:29.325+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:29.401 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:29.397+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:29.646 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:29.642+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:29.647 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:29.643+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:29.747 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:29.740+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:30.314 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:30.312+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:30.333 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:30.330+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:30.358 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:30.335+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:30.404 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:30.402+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:30.676 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:30.666+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:30.678 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:30.671+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:30.767 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:30.764+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:31.299 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:31.296+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:31.342 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:31.339+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:31.369 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:31.359+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:31.432 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:31.428+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:31.683 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:31.680+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:31.683 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:31.681+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:31.754 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:31.751+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:32.263 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:32.259+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:32.315 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:32.312+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:32.343 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:32.316+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:32.426 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:32.422+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:32.673 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:32.669+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:32.673 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:32.671+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:32.784 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:32.781+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:33.271 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:33.267+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:33.326 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:33.322+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:33.331 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:33.328+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:33.467 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:33.463+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:33.681 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:33.677+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:33.682 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:33.679+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:33.803 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:33.799+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:34.312 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:34.308+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:34.321 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:34.312+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:34.349 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:34.346+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:34.504 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:34.500+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:34.702 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:34.699+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:34.706 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:34.703+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:34.840 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:34.836+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:35.266 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:35.262+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:35.360 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:35.356+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:35.376 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:35.374+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:35.533 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:35.529+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:35.675 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:35.672+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:35.675 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:35.673+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:35.818 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:35.814+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:36.231 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:36.227+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:36.327 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:36.323+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:36.330 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:36.328+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:36.541 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:36.537+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:36.699 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:36.696+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:36.700 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:36.698+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:36.872 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:36.867+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:37.196 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:37.192+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:37.309 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:37.306+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:37.331 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:37.327+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:37.543 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:37.535+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:37.697 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:37.692+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:37.697 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:37.694+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:37.893 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:37.887+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:38.159 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:38.154+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:38.297 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:38.293+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:38.380 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:38.376+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:38.512 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:38.509+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:38.657 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:38.654+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:38.658 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:38.655+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:38.861 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:38.857+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:39.185 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:39.181+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:39.286 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:39.282+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:39.342 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:39.339+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:39.489 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:39.486+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:39.694 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:39.690+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:39.697 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:39.695+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:39.889 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:39.887+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:40.174 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:40.171+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:40.316 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:40.313+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:40.373 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:40.367+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:40.468 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:40.464+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:40.694 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:40.691+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:40.695 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:40.692+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:40.931 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:40.927+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:41.194 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:41.189+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:41.359 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:41.356+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:41.421 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:41.418+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:41.487 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:41.483+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:41.651 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:41.647+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:41.651 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:41.649+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:41.893 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:41.890+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:42.228 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:42.215+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:42.318 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:42.310+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:42.406 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:42.403+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:42.499 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:42.496+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:42.612 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:42.608+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:42.613 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:42.610+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:42.931 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:42.927+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:43.203 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:43.198+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:43.279 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:43.275+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:43.452 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:43.448+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:43.461 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:43.458+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:43.665 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:43.655+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:43.665 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:43.657+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:43.943 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:43.939+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:44.233 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:44.230+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:44.244 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:44.241+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:44.485 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:44.481+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:44.492 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:44.488+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:44.700 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:44.696+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:44.701 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:44.698+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:44.932 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:44.929+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:45.207 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:45.203+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:45.228 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:45.223+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:45.478 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:45.475+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:45.513 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:45.509+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:45.678 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:45.674+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:45.679 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:45.676+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:45.925 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:45.921+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:46.163 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:46.160+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:46.226 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:46.222+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:46.469 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:46.463+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:46.557 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:46.553+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:46.695 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:46.691+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:46.696 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:46.693+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:46.896 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:46.892+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:47.116 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:47.114+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:47.225 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:47.222+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:47.445 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:47.441+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:47.572 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:47.568+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:47.655 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:47.650+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:47.656 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:47.652+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:47.946 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:47.917+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:48.164 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:48.160+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:48.266 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:48.262+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:48.444 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:48.441+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:48.597 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:48.594+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:48.652 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:48.647+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:48.652 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:48.650+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:48.951 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:48.946+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:49.211 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:49.208+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:49.252 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:49.248+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:49.478 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:49.474+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:49.537 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:43:49.535+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e291 v291) 2019-11-27T23:43:49.635 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:49.633+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:49.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:49.684+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:49.689 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:49.685+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:49.915 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:49.911+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:50.214 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:50.210+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:50.245 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:50.237+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:50.482 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:50.479+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:50.669 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:50.666+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:50.677 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:50.673+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:50.677 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:50.675+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:50.964 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:50.960+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:51.201 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:51.197+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:51.213 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:51.210+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:51.445 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:51.437+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:51.650 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:51.648+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:51.704 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:51.701+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:51.705 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:51.702+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:51.925 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:51.921+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:52.201 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:52.198+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:52.231 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:52.226+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:52.419 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:52.415+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:52.616 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:52.614+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:52.744 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:52.741+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:52.747 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:52.746+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:52.889 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:52.885+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:53.195 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:53.190+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:53.252 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:53.249+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:53.436 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:53.433+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:53.637 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:53.635+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:53.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:53.721+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:53.724 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:53.722+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:53.896 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:53.893+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:54.152 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:54.148+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:54.247 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:54.242+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:54.470 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:54.466+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:54.563 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:43:54.557+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e291 v291) 2019-11-27T23:43:54.633 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:54.631+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:54.723 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:54.721+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:54.725 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:54.724+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:54.937 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:54.933+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:55.137 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:55.134+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:55.240 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:55.237+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:55.452 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:55.448+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:55.647 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:55.645+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:55.742 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:55.740+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:55.746 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:55.744+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:55.980 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:55.975+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:56.092 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:56.090+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:56.283 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:56.280+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:56.494 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:56.491+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:56.671 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:56.668+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:56.773 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:56.767+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:56.780 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:56.777+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:57.005 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:57.001+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:57.126 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:57.123+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:57.317 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:57.313+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:57.545 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:57.540+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:57.643 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:57.641+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:57.801 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:57.797+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:57.802 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:57.798+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:58.026 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:58.022+0000 1694c700 -1 osd.3 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:58.100 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:58.097+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:58.336 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:58.333+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:58.527 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:58.523+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:58.656 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:58.653+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:58.779 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:58.775+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:58.781 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:58.778+0000 1694c700 -1 osd.4 291 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:43:59.103 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:43:59.098+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:43:59.162 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:43:59.071+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:43:59.306 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:43:59.302+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:43:59.568 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:43:59.567+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e291 v291) 2019-11-27T23:43:59.596 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:43:59.565+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:43:59.661 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:43:59.659+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:43:59.785 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:59.774+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:43:59.787 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:43:59.786+0000 1694c700 -1 osd.4 292 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:00.076 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:44:00.069+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:44:00.152 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:00.149+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:00.344 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:44:00.339+0000 1694c700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:44:00.625 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:44:00.619+0000 1694c700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:44:00.672 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:44:00.665+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:44:00.816 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:00.812+0000 1694c700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:44:00.816 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:00.814+0000 1694c700 -1 osd.4 293 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:01.112 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:01.109+0000 1694c700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:01.122 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:44:01.119+0000 1694c700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:44:01.366 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:44:01.363+0000 1694c700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:44:01.588 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:44:01.583+0000 1694c700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:44:01.705 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:44:01.700+0000 1694c700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:44:01.815 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:01.802+0000 1694c700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:44:01.816 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:01.804+0000 1694c700 -1 osd.4 293 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:02.173 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:02.155+0000 1694c700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:02.180 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:44:02.168+0000 1694c700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:44:02.428 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:44:02.389+0000 1694c700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:44:02.691 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:44:02.623+0000 1694c700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:44:02.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:44:02.734+0000 1694c700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:44:02.851 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:02.849+0000 1694c700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:44:02.852 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:02.850+0000 1694c700 -1 osd.4 294 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:03.142 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:03.140+0000 1694c700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:03.197 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:44:03.194+0000 1694c700 -1 osd.3 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:44:03.474 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:44:03.471+0000 1694c700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:44:03.695 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:44:03.692+0000 1694c700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:44:03.753 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:44:03.750+0000 1694c700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:44:03.986 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:03.905+0000 1694c700 -1 osd.4 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:44:03.990 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:03.906+0000 1694c700 -1 osd.4 295 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:04.171 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:04.169+0000 1694c700 -1 osd.7 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:04.273 INFO:tasks.ceph.osd.3.smithi156.stderr:2019-11-27T23:44:04.263+0000 1694c700 -1 osd.3 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:38.027918+0000 front 2019-11-27T23:42:37.943178+0000 (oldest deadline 2019-11-27T23:43:23.794208+0000) 2019-11-27T23:44:04.501 INFO:tasks.ceph.osd.0.smithi156.stderr:2019-11-27T23:44:04.496+0000 1694c700 -1 osd.0 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:33.832775+0000 front 2019-11-27T23:42:32.415960+0000 (oldest deadline 2019-11-27T23:43:18.270322+0000) 2019-11-27T23:44:04.647 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:44:04.635+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.3:6816/9704,v1:172.21.15.3:6817/9704] for 43sec e291 v291) 2019-11-27T23:44:04.718 INFO:tasks.ceph.osd.1.smithi156.stderr:2019-11-27T23:44:04.714+0000 1694c700 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.557513+0000 front 2019-11-27T23:42:36.651327+0000 (oldest deadline 2019-11-27T23:43:22.330592+0000) 2019-11-27T23:44:04.775 INFO:tasks.ceph.osd.6.smithi003.stderr:2019-11-27T23:44:04.772+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.098020+0000 front 2019-11-27T23:42:36.079835+0000 (oldest deadline 2019-11-27T23:43:18.499247+0000) 2019-11-27T23:44:04.866 INFO:teuthology.orchestra.run.smithi156.stderr:testIfNoneMatch (test.functional.tests.TestFileComparisonUTF8) ... ok 2019-11-27T23:44:04.931 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:04.929+0000 1694c700 -1 osd.4 295 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:36.675778+0000 front 2019-11-27T23:42:36.654141+0000 (oldest deadline 2019-11-27T23:43:18.762728+0000) 2019-11-27T23:44:04.932 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:04.930+0000 1694c700 -1 osd.4 295 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:05.167 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:05.164+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.3:6820 osd.5 since back 2019-11-27T23:42:35.667711+0000 front 2019-11-27T23:42:36.561198+0000 (oldest deadline 2019-11-27T23:43:18.544712+0000) 2019-11-27T23:44:06.215 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:06.213+0000 1694c700 -1 osd.4 297 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:07.400 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:07.364+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:08.410 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:08.409+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:09.423 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:09.416+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:10.382 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:10.379+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:11.417 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:11.414+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:11.781 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:44:11.774+0000 1a899700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-11-27T23:44:12.378 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:12.374+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:13.430 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:13.428+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:14.412 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:14.409+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:15.374 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:15.372+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:16.364 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:16.361+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:17.357 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:17.354+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:18.381 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:18.379+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:19.381 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:19.378+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:20.356 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:20.353+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 11 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:21.324 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:21.320+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:22.359 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:22.356+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:23.396 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:23.393+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:24.428 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:24.425+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:25.399 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:25.396+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:26.362 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:26.358+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:27.317 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:27.315+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:28.318 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:28.315+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:29.292 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:29.289+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:30.295 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:30.292+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:31.307 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:31.305+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:32.265 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:32.261+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:32.384 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:32.378+0000 1694c700 -1 osd.7 299 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128346 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 821263216 gen 45] snapc 0=[] ondisk+write+known_if_redirected e294) 2019-11-27T23:44:33.231 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:33.229+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:33.434 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:33.433+0000 1694c700 -1 osd.7 299 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128346 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 821263216 gen 45] snapc 0=[] ondisk+write+known_if_redirected e294) 2019-11-27T23:44:34.241 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:34.240+0000 1694c700 -1 osd.4 299 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:34.494 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:34.480+0000 1694c700 -1 osd.7 299 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128346 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 821263216 gen 45] snapc 0=[] ondisk+write+known_if_redirected e294) 2019-11-27T23:44:35.286 INFO:tasks.ceph.osd.4.smithi003.stderr:2019-11-27T23:44:35.282+0000 1694c700 -1 osd.4 300 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4537.0:128104 5.e 5:7759931f:::notify.3:head [watch ping cookie 440514352 gen 9] snapc 0=[] ondisk+write+known_if_redirected e291) 2019-11-27T23:44:35.452 INFO:tasks.ceph.osd.7.smithi003.stderr:2019-11-27T23:44:35.450+0000 1694c700 -1 osd.7 299 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4537.0:128346 5.d 5:b4812045:::notify.4:head [watch reconnect cookie 821263216 gen 45] snapc 0=[] ondisk+write+known_if_redirected e294) 2019-11-27T23:44:35.947 INFO:tasks.rgw.client.0.smithi156.stdout:2019-11-27T23:44:35.886+0000 20e22700 -1 RGWWatcher::handle_error cookie 440514352 err (107) Transport endpoint is not connected 2019-11-27T23:44:53.295 INFO:tasks.ceph.osd.5.smithi003.stderr:*** Caught signal (Aborted) ** 2019-11-27T23:44:53.295 INFO:tasks.ceph.osd.5.smithi003.stderr: in thread 38791700 thread_name:tp_osd_tp 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: 2: (_IO_vfprintf()+0x4a79) [0xd15a029] 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: 3: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: 4: (cls_log()+0xfa) [0x69b07a] 2019-11-27T23:44:53.393 INFO:tasks.ceph.osd.5.smithi003.stderr: 5: (()+0x23201) [0x209e9201] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 6: (()+0x15342) [0x209db342] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 7: (()+0x65bc6e) [0x763c6e] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 8: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 9: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 10: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 11: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T23:44:53.394 INFO:tasks.ceph.osd.5.smithi003.stderr: 12: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 13: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 18: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T23:44:53.395 INFO:tasks.ceph.osd.5.smithi003.stderr: 19: (()+0x7e65) [0xc093e65] 2019-11-27T23:44:53.396 INFO:tasks.ceph.osd.5.smithi003.stderr: 20: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:44:53.434 INFO:tasks.ceph.osd.5.smithi003.stderr:2019-11-27T23:44:53.427+0000 38791700 -1 *** Caught signal (Aborted) ** 2019-11-27T23:44:53.434 INFO:tasks.ceph.osd.5.smithi003.stderr: in thread 38791700 thread_name:tp_osd_tp 2019-11-27T23:44:53.434 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:53.434 INFO:tasks.ceph.osd.5.smithi003.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:44:53.434 INFO:tasks.ceph.osd.5.smithi003.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 2: (_IO_vfprintf()+0x4a79) [0xd15a029] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 3: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 4: (cls_log()+0xfa) [0x69b07a] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 5: (()+0x23201) [0x209e9201] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 6: (()+0x15342) [0x209db342] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 7: (()+0x65bc6e) [0x763c6e] 2019-11-27T23:44:53.435 INFO:tasks.ceph.osd.5.smithi003.stderr: 8: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 9: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 10: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 11: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 12: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 13: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T23:44:53.436 INFO:tasks.ceph.osd.5.smithi003.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 18: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 19: (()+0x7e65) [0xc093e65] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: 20: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:44:53.437 INFO:tasks.ceph.osd.5.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:44:53.438 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:53.865 INFO:tasks.ceph.osd.5.smithi003.stderr: -15> 2019-11-27T23:44:53.427+0000 38791700 -1 *** Caught signal (Aborted) ** 2019-11-27T23:44:53.865 INFO:tasks.ceph.osd.5.smithi003.stderr: in thread 38791700 thread_name:tp_osd_tp 2019-11-27T23:44:53.865 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: 2: (_IO_vfprintf()+0x4a79) [0xd15a029] 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: 3: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: 4: (cls_log()+0xfa) [0x69b07a] 2019-11-27T23:44:53.866 INFO:tasks.ceph.osd.5.smithi003.stderr: 5: (()+0x23201) [0x209e9201] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 6: (()+0x15342) [0x209db342] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 7: (()+0x65bc6e) [0x763c6e] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 8: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 9: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 10: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 11: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T23:44:53.867 INFO:tasks.ceph.osd.5.smithi003.stderr: 12: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 13: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T23:44:53.868 INFO:tasks.ceph.osd.5.smithi003.stderr: 18: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T23:44:53.869 INFO:tasks.ceph.osd.5.smithi003.stderr: 19: (()+0x7e65) [0xc093e65] 2019-11-27T23:44:53.869 INFO:tasks.ceph.osd.5.smithi003.stderr: 20: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:44:53.869 INFO:tasks.ceph.osd.5.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:44:53.869 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:54.235 INFO:tasks.ceph.osd.5.smithi003.stderr: -272> 2019-11-27T23:44:53.427+0000 38791700 -1 *** Caught signal (Aborted) ** 2019-11-27T23:44:54.235 INFO:tasks.ceph.osd.5.smithi003.stderr: in thread 38791700 thread_name:tp_osd_tp 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: ceph version 15.0.0-7725-g0073295 (00732956b62306ff37a7f7c81af9db807aae2dc8) octopus (dev) 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 2: (_IO_vfprintf()+0x4a79) [0xd15a029] 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 3: (__vsnprintf_chk()+0x95) [0xd222d75] 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 4: (cls_log()+0xfa) [0x69b07a] 2019-11-27T23:44:54.236 INFO:tasks.ceph.osd.5.smithi003.stderr: 5: (()+0x23201) [0x209e9201] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 6: (()+0x15342) [0x209db342] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 7: (()+0x65bc6e) [0x763c6e] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 8: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763ffa] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 9: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822473] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 10: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x83191f] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 11: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x8320bc] 2019-11-27T23:44:54.237 INFO:tasks.ceph.osd.5.smithi003.stderr: 12: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x83692f] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 13: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c72d] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc489] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x914282] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6ee5] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd15da] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 18: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd99e0] 2019-11-27T23:44:54.238 INFO:tasks.ceph.osd.5.smithi003.stderr: 19: (()+0x7e65) [0xc093e65] 2019-11-27T23:44:54.239 INFO:tasks.ceph.osd.5.smithi003.stderr: 20: (clone()+0x6d) [0xd20b88d] 2019-11-27T23:44:54.239 INFO:tasks.ceph.osd.5.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-27T23:44:54.239 INFO:tasks.ceph.osd.5.smithi003.stderr: 2019-11-27T23:44:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:testIfUnmodifiedSince (test.functional.tests.TestFileComparisonUTF8) ... ok 2019-11-27T23:44:57.312 INFO:tasks.ceph.osd.5.smithi003.stderr:daemon-helper: command crashed with signal 6 2019-11-27T23:45:25.239 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:45:32.714 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.249 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:45:32.723 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.258 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:45:32.734 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.260 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:45:32.736 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.263 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:45:32.739 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.265 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:45:32.741 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.552 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:45:33.028 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.577 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:45:33.052 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:45:25.610 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:45:33.084 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:46:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:testBadHeaders (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:46:00.609 INFO:teuthology.orchestra.run.smithi156.stderr:testBlankMetadataName (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:48:10.931 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:48:18.405 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:10.998 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:48:18.472 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.006 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:48:18.482 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.011 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:48:18.487 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.091 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:48:18.566 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.094 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:48:18.570 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.170 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:48:18.645 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.191 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:48:18.666 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:48:11.272 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:48:18.747 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.487 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:50:28.961 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.498 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:50:28.973 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.503 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:50:28.977 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.507 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:50:28.983 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.507 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:50:28.984 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.519 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:50:28.995 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.624 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:50:29.100 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.645 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:50:29.121 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:50:21.714 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:50:29.186 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.044 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:52:14.518 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.098 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:52:14.573 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.118 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:52:14.594 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.126 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:52:14.602 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.157 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:52:14.632 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.165 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:52:14.641 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.211 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:52:14.685 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.253 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:52:14.729 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:52:07.264 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:52:14.739 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:00.799 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-27T23:55:00.795+0000 1a899700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-11-27T23:55:04.257 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:55:11.732 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.263 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:55:11.737 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.279 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:55:11.754 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.281 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:55:11.756 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.283 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:55:11.759 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.290 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:55:11.763 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.498 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:55:11.972 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.512 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:55:11.988 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:55:04.548 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:55:12.024 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.237 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:56:40.711 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.253 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:56:40.728 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.268 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:56:40.744 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.290 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:56:40.766 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.325 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:56:40.801 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.328 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:56:40.804 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.401 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:56:40.875 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.420 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:56:40.896 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:56:33.488 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:56:40.963 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:58:44.933 INFO:teuthology.orchestra.run.smithi156.stderr:testChunkedPut (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:58:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:testContentTypeGuessing (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:59:24.722 INFO:teuthology.orchestra.run.smithi156.stderr:testCopy (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:59:26.463 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:59:33.937 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.472 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:59:33.946 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.485 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:59:33.961 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.494 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:59:33.963 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.547 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:59:34.023 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.551 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:59:34.027 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.666 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:08:59:34.142 9505== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.710 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:08:59:34.184 8386== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:26.723 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:08:59:34.199 9506== Warning: unimplemented fcntl command: 1036 2019-11-27T23:59:41.061 INFO:teuthology.orchestra.run.smithi156.stderr:testCopy404s (test.functional.tests.TestFileUTF8) ... ok 2019-11-27T23:59:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:00.138 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-28T00:00:00.135+0000 1a899700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 5/1516 objects unfound (0.330%); Reduced data availability: 2 pgs inactive, 2 pgs down; Possible data damage: 1 pg recovery_unfound; Degraded data redundancy: 10/3032 objects degraded (0.330%), 1 pg degraded, 1 pg undersized; 2 daemons have recently crashed 2019-11-28T00:00:18.955 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyFromHeader (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:27.979 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyFromHeader404s (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:30.790 INFO:teuthology.orchestra.run.smithi156.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:38.506 INFO:teuthology.orchestra.run.smithi156.stderr:testDelete (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:40.416 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:49.298 INFO:teuthology.orchestra.run.smithi156.stderr:testDeleteThen404s (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:50.745 INFO:teuthology.orchestra.run.smithi156.stderr:testEtagResponse (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:00:51.246 INFO:teuthology.orchestra.run.smithi156.stderr:testEtagWayoff (test.functional.tests.TestFileUTF8) ... ok 2019-11-28T00:04:25.162 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:04:32.636 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.176 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:04:32.650 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.177 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:04:32.653 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.178 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:04:32.654 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.181 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:04:32.658 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.189 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:04:32.660 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.394 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:04:32.870 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.401 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:04:32.877 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:04:25.447 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:04:32.921 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.450 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:05:07.924 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.455 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:05:07.929 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.494 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:05:07.970 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.499 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:05:07.975 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.521 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:05:07.996 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.525 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:05:08.001 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.527 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:05:08.001 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.541 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:05:08.017 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:05:00.553 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:05:08.029 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.523 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:09:43.997 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.532 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:09:44.006 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.552 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:09:44.028 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.556 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:09:44.032 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.558 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:09:44.034 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.565 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:09:44.041 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.792 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:09:44.267 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.797 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:09:44.271 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:09:36.847 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:09:44.323 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.350 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:13:29.824 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.353 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:13:29.827 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.395 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:13:29.871 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.408 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:13:29.884 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.418 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:13:29.894 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.427 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:13:29.903 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.540 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:13:30.016 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.549 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:13:30.025 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:13:22.590 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:13:30.064 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.715 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:14:55.190 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.722 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:14:55.196 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.733 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:14:55.209 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.739 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:14:55.215 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.742 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:14:55.218 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.748 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:14:55.224 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.864 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:14:55.338 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.884 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:14:55.360 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:14:47.887 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:14:55.363 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.916 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:20:07.390 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.929 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:20:07.403 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.933 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:20:07.409 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.934 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:20:07.410 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.937 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:20:07.413 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:19:59.939 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:20:07.415 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.135 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:20:07.611 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.142 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:20:07.618 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:20:00.246 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:20:07.720 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.354 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:21:51.828 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.377 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:21:51.851 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.393 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:21:51.868 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.405 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:21:51.881 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.407 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:21:51.883 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.427 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:21:51.903 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.477 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:21:51.951 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.502 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:21:51.978 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:21:44.503 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:21:51.978 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.293 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:24:32.767 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.302 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:24:32.776 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.355 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:24:32.830 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.360 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:24:32.835 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.360 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:24:32.836 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.377 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:24:32.853 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.434 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:24:32.908 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.487 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:24:32.963 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:24:25.518 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:24:32.993 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.317 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:25:16.790 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.335 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:25:16.809 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.338 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:25:16.814 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.342 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:25:16.817 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.342 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:25:16.818 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.348 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:25:16.823 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.423 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:25:16.898 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.424 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:25:16.899 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:25:09.427 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:25:16.901 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.786 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:14.260 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.804 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:14.278 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.854 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:14.330 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.861 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:14.337 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.871 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:14.346 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:06.871 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:14.347 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:07.004 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:14.478 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:07.016 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:14.491 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:07.055 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:14.531 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.515 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:28.986 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.525 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:28.999 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.535 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:29.011 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.539 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:29.015 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.539 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:29.015 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.543 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:29.019 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.577 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:30:29.053 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.593 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:30:29.069 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:30:21.630 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:30:29.104 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.220 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:35:41.693 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.235 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:35:41.709 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.236 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:35:41.706 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.238 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:35:41.714 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.253 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:35:41.730 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.258 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:35:41.734 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.466 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:35:41.942 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.467 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:35:41.943 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:35:34.530 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:35:42.004 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.837 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:38:36.311 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.852 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:38:36.326 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.853 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:38:36.314 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.872 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:38:36.348 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.876 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:38:36.352 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.897 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:38:36.373 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.965 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:38:36.441 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:28.999 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:38:36.473 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:38:29.015 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:38:36.491 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:45.960 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:40:53.434 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:45.980 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:40:53.446 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:45.990 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:40:53.466 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:45.994 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:40:53.470 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:45.997 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:40:53.473 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:46.002 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:40:53.478 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:46.141 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:40:53.616 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:46.149 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:40:53.623 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:40:46.179 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:40:53.655 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.015 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:07.488 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.147 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:07.504 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.147 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:07.509 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.147 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:07.510 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.147 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:07.513 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.147 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:07.492 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.233 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:07.708 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.240 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:07.716 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:00.288 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:07.761 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:50.905 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:58.379 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:50.944 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:58.418 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:50.989 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:58.465 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:50.994 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:58.470 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:51.004 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:58.480 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:51.010 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:58.486 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:51.011 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:46:58.485 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:51.050 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:46:58.526 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:46:51.066 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:46:58.542 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.312 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:51:15.786 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.323 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:51:15.797 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.327 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:51:15.803 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.331 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:51:15.807 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.344 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:51:15.820 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.348 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:51:15.824 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.510 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:51:15.986 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.608 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:51:16.082 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:51:08.624 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:51:16.100 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.924 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:55:20.398 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.970 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:55:20.445 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.980 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:55:20.456 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.982 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:55:20.458 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.991 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:55:20.464 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:12.993 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:55:20.469 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:13.128 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:55:20.603 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:13.142 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:55:20.618 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:55:13.258 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:55:20.732 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.482 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:56:27.956 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.499 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:56:27.970 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.500 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:56:27.975 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.500 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:56:27.970 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.500 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:56:27.963 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.501 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:56:27.975 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.562 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:09:56:28.038 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.569 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:09:56:28.045 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T00:56:20.631 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:09:56:28.104 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:00:00.003 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-28T01:00:00.000+0000 1a899700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 5/1525 objects unfound (0.328%); Reduced data availability: 2 pgs inactive, 2 pgs down; Possible data damage: 1 pg recovery_unfound; Degraded data redundancy: 10/3050 objects degraded (0.328%), 1 pg degraded, 1 pg undersized; 2 daemons have recently crashed 2019-11-28T01:01:30.631 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:01:38.104 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.641 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:01:38.114 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.647 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:01:38.122 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.648 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:01:38.123 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.651 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:01:38.127 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.654 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:01:38.129 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.841 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:01:38.316 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.845 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:01:38.321 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:01:30.920 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:01:38.394 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:34.949 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:03:42.422 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.773 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:03:42.486 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.773 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:03:42.492 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.773 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:03:42.574 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.773 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:03:42.494 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.774 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:03:42.496 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.774 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:03:42.566 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.774 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:03:42.427 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:03:58.774 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:03:42.567 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.704 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:05:43.178 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.718 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:05:43.190 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.795 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:05:43.271 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.797 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:05:43.273 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.801 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:05:43.277 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.803 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:05:43.279 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.862 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:05:43.335 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.884 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:05:43.360 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:05:35.890 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:05:43.366 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.078 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:06:48.552 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.091 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:06:48.564 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.107 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:06:48.583 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.113 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:06:48.589 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.115 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:06:48.591 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.133 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:06:48.608 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.212 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:06:48.687 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.215 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:06:48.688 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:06:41.216 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:06:48.692 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.327 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:01.800 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.340 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:01.812 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.344 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:01.819 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.344 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:01.820 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.346 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:01.822 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.352 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:01.828 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.554 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:02.030 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.587 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:02.063 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:54.598 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:02.071 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.269 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:04.742 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.278 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:04.751 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.305 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:12:04.779 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.336 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:04.811 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.336 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:04.812 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.339 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:04.815 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.357 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:12:04.832 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.359 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:04.835 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:11:57.374 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:12:04.850 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.676 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:17:13.149 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.686 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:17:13.159 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.819 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:17:13.294 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.823 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:17:13.298 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.823 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:17:13.298 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:05.830 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:17:13.306 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:06.026 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:17:13.499 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:06.055 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:17:13.530 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:17:06.057 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:17:13.533 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.251 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:20:26.724 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.301 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:20:26.774 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.342 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:20:26.818 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.350 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:20:26.826 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.382 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:20:26.857 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.384 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:20:26.860 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.423 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:20:26.896 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.461 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:20:26.936 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:20:19.490 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:20:26.966 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.468 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:22:24.942 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.480 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:22:24.954 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.492 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:22:24.967 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.497 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:22:24.972 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.497 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:22:24.973 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.503 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:22:24.978 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.600 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:22:25.076 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.603 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:22:25.079 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:22:17.638 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:22:25.111 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:30.954 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:27:38.427 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:30.973 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:27:38.446 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:30.993 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:27:38.468 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:30.996 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:27:38.472 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:30.997 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:27:38.473 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:31.008 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:27:38.484 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:31.224 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:27:38.700 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:31.319 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:27:38.792 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:27:31.343 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:27:38.819 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.212 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:28:48.688 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.232 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:28:48.705 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.244 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:28:48.719 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.247 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:28:48.722 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.254 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:28:48.727 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.255 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:28:48.730 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.321 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:28:48.797 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.323 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:28:48.798 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:28:41.379 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:28:48.852 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.161 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:32:49.634 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.169 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:32:49.642 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.173 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:32:49.648 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.175 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:32:49.650 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.179 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:32:49.653 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.180 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:32:49.655 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.350 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:32:49.826 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.352 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:32:49.827 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:32:42.405 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:32:49.878 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.327 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:37:10.799 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.331 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:37:10.804 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.364 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:37:10.837 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.391 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:37:10.867 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.405 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:37:10.880 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.410 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:37:10.886 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.539 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:37:11.014 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.546 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:37:11.017 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:03.651 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:37:11.124 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.584 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:38:01.057 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.591 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:38:01.064 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.609 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:38:01.084 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.612 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:38:01.087 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.615 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:38:01.091 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.618 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:38:01.093 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.695 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:38:01.168 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.696 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:38:01.171 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:37:53.703 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:38:01.179 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.269 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:43:13.742 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.279 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:43:13.752 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.289 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:43:13.765 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.296 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:43:13.771 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.296 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:43:13.771 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.299 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:43:13.774 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.510 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:43:13.985 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.540 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:43:14.015 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:43:06.552 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:43:14.024 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.428 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:45:32.900 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.432 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:45:32.904 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.488 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:45:32.963 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.496 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:45:32.972 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.498 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:45:32.973 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.509 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:45:32.984 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.608 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:45:33.082 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.614 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:45:33.087 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:45:25.636 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:45:33.111 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.270 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:47:03.742 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.273 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:47:03.745 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.327 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:47:03.801 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.339 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:47:03.814 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.341 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:47:03.816 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.374 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:47:03.850 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.401 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:47:03.873 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.417 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:47:03.892 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:46:56.452 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:47:03.927 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.466 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:48:23.939 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.485 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:48:23.958 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.486 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:48:23.961 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.491 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:48:23.966 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.495 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:48:23.970 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.503 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:48:23.978 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.603 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:48:24.078 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.614 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:48:24.089 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:48:16.670 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:48:24.143 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.734 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:36.206 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.755 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:36.227 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.759 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:36.234 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.766 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:36.241 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.772 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:36.247 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.777 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:36.251 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:28.989 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:36.464 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:29.024 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:36.487 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:29.042 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:36.517 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.843 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:55.316 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.852 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:55.325 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.892 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:55.367 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.893 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:53:55.365 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.896 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:55.371 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.917 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:55.392 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.919 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:55.394 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.929 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:53:55.404 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:53:47.940 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:53:55.415 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.856 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:58:48.328 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.868 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:58:48.340 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.883 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:58:48.358 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.890 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:58:48.365 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.893 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:58:48.368 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:40.898 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:58:48.373 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:41.126 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:10:58:48.601 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:41.159 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:10:58:48.633 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T01:58:41.211 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:10:58:48.683 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:00:00.004 INFO:tasks.ceph.mon.b.smithi003.stderr:2019-11-28T02:00:00.000+0000 1a899700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 5/1525 objects unfound (0.328%); Reduced data availability: 2 pgs inactive, 2 pgs down; Possible data damage: 1 pg recovery_unfound; Degraded data redundancy: 10/3050 objects degraded (0.328%), 1 pg degraded, 1 pg undersized; 2 daemons have recently crashed 2019-11-28T02:02:09.812 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:02:17.285 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.856 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:02:17.329 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.901 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:02:17.375 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.914 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:02:17.389 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.915 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:02:17.390 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.926 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:02:17.401 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:09.996 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:02:17.468 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:10.027 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:02:17.501 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:02:10.032 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:02:17.507 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.430 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:03:57.901 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.443 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:03:57.915 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.450 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:03:57.925 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.461 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:03:57.936 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.462 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:03:57.937 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.469 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:03:57.944 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.566 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:03:58.041 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.583 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:03:58.058 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:03:50.658 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:03:58.131 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.483 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:09:10.955 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.503 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:09:10.975 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.513 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:09:10.984 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.513 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:09:10.988 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.517 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:09:10.992 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.521 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:09:10.995 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.753 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:09:11.228 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.757 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:09:11.232 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:09:03.781 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:09:11.254 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.912 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:10:39.384 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.918 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:10:39.391 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.949 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:10:39.424 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.957 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:10:39.432 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.976 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:10:39.449 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.984 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:10:39.459 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:31.993 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:10:39.465 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:32.046 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:10:39.521 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:10:32.050 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:10:39.525 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:14.992 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:14:22.464 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.008 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:14:22.479 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.012 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:14:22.486 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.012 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:14:22.486 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.019 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:14:22.494 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.019 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:14:22.494 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.191 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:14:22.666 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.193 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:14:22.668 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:14:15.303 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:14:22.775 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:53.948 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:01.420 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:53.950 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:01.423 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.012 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:01.487 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.020 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:01.494 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.024 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:01.499 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.033 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:01.508 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.104 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:01.576 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.181 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:01.656 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:18:54.196 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:01.670 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.965 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:33.436 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.981 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:33.456 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.985 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:33.457 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.991 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:33.466 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.994 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:33.469 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:25.997 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:33.472 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:26.056 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:19:33.531 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:26.060 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:19:33.534 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:19:26.119 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:19:33.591 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.131 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:24:47.603 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.144 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:24:47.615 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.150 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:24:47.624 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.153 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:24:47.628 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.154 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:24:47.628 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.160 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:24:47.635 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.352 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:24:47.826 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.366 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:24:47.841 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:24:40.418 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:24:47.890 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.490 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:27:23.962 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.539 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:27:24.011 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.549 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:27:24.023 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.551 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:27:24.026 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.609 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:27:24.084 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.611 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:27:24.086 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.636 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:27:24.111 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.667 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:27:24.139 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:27:16.700 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:27:24.174 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.144 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:28:34.616 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.153 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:28:34.626 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.224 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:28:34.698 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.226 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:28:34.700 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.237 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:28:34.709 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.240 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:28:34.715 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.242 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:28:34.717 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.296 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:28:34.771 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:28:27.346 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:28:34.820 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.361 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:29:59.832 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.378 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:29:59.850 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.382 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:29:59.857 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.386 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:29:59.861 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.386 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:29:59.861 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.392 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:29:59.866 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.483 INFO:tasks.ceph.mon.a.smithi156.stderr:==00:11:29:59.958 9505== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.502 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:11:29:59.977 9506== Warning: unimplemented fcntl command: 1036 2019-11-28T02:29:52.527 INFO:tasks.ceph.mon.b.smithi003.stderr:==00:11:29:59.998 8386== Warning: unimplemented fcntl command: 1036 2019-11-28T02:34:57.973 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-28T02:34:57.975 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2019-11-28T02:34:57.975 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2019-11-28T02:34:57.975 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2019-11-28T02:34:57.976 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2019-11-28T02:34:57.976 DEBUG:teuthology.exit:Finished running handlers