2020-08-30T14:22:33.739 INFO:root:teuthology version: 1.0.0-018d708
2020-08-30T14:22:33.744 INFO:teuthology.results:subset: '1/9999'
2020-08-30T14:22:33.745 INFO:teuthology.results:seed: '4084'
2020-08-30T14:28:35.104 INFO:root:teuthology version: 1.0.0-018d708
2020-08-30T14:28:35.129 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-08-30T16:36:38.796 INFO:teuthology.results:Tests finished! gathering results...
2020-08-30T16:36:40.576 INFO:scrape:Found 17 jobs
2020-08-30T16:36:40.926 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-3528-g22d78a69441 (22d78a6944122a43cb38c14233d3f38c44c097e7) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fce547e8249]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fce547e8424]

2020-08-30T16:36:40.978 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub
, 2020-08-30T14:51:20.545 INFO:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json
, 2020-08-30T14:51:20.799 INFO:teuthology.orchestra.run.smithi203.stdout:

2020-08-30T16:36:40.979 WARNING:scrape:Ignoring malparsed backtrace:     raise value.with_traceback(tb)
,   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-fix-manifest-tier/qa/tasks/rados.py", line 266, in thread

2020-08-30T16:36:40.980 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait
,     proc.wait()

2020-08-30T16:36:41.139 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-3528-g22d78a69441 (22d78a6944122a43cb38c14233d3f38c44c097e7) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fce547e8249]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fce547e8424]

2020-08-30T16:36:41.143 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub
, 2020-08-30T14:51:20.545 INFO:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json
, 2020-08-30T14:51:20.799 INFO:teuthology.orchestra.run.smithi203.stdout:

2020-08-30T16:36:41.143 WARNING:scrape:Ignoring malparsed backtrace:     raise value.with_traceback(tb)
,   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-fix-manifest-tier/qa/tasks/rados.py", line 266, in thread

2020-08-30T16:36:41.144 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait
,     proc.wait()

2020-08-30T16:36:41.294 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-3528-g22d78a69441 (22d78a6944122a43cb38c14233d3f38c44c097e7) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fce547e8249]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fce547e8424]

2020-08-30T16:36:41.297 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub
, 2020-08-30T14:51:20.545 INFO:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json
, 2020-08-30T14:51:20.799 INFO:teuthology.orchestra.run.smithi203.stdout:

2020-08-30T16:36:41.298 WARNING:scrape:Ignoring malparsed backtrace:     raise value.with_traceback(tb)
,   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-fix-manifest-tier/qa/tasks/rados.py", line 266, in thread

2020-08-30T16:36:41.299 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait
,     proc.wait()

2020-08-30T16:36:41.449 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-3528-g22d78a69441 (22d78a6944122a43cb38c14233d3f38c44c097e7) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fce547e8249]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fce547e8424]

2020-08-30T16:36:41.453 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub
, 2020-08-30T14:51:20.545 INFO:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json
, 2020-08-30T14:51:20.799 INFO:teuthology.orchestra.run.smithi203.stdout:

2020-08-30T16:36:41.454 WARNING:scrape:Ignoring malparsed backtrace:     raise value.with_traceback(tb)
,   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-fix-manifest-tier/qa/tasks/rados.py", line 266, in thread

2020-08-30T16:36:41.454 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait
,     proc.wait()

2020-08-30T16:36:41.915 INFO:scrape:Found 3 distinct failure reasons
2020-08-30T16:36:41.916 INFO:scrape:Failure: Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest)
2020-08-30T16:36:41.917 INFO:scrape:9 jobs: ['5391380', '5391374', '5391377', '5391378', '5391388', '5391381', '5391386', '5391384', '5391390']
2020-08-30T16:36:41.917 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}']
2020-08-30T16:36:41.918 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}']
2020-08-30T16:36:41.918 INFO:scrape:
2020-08-30T16:36:41.919 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'
2020-08-30T16:36:41.919 INFO:scrape:1 jobs: ['5391389']
2020-08-30T16:36:41.920 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}']
2020-08-30T16:36:41.920 INFO:scrape:
2020-08-30T16:36:41.921 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds
2020-08-30T16:36:41.921 INFO:scrape:1 jobs: ['5391385']
2020-08-30T16:36:41.921 INFO:scrape:suites: ['1-install/octopus', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}']
2020-08-30T16:36:41.922 INFO:scrape: