2021-01-05T13:35:21.718 INFO:root:teuthology version: 1.0.0-8e49dda4
2021-01-05T13:35:21.720 INFO:teuthology.results:seed: '2477'
2021-01-05T13:37:20.021 INFO:root:teuthology version: 1.0.0-8e49dda4
2021-01-05T13:37:20.024 INFO:teuthology.results:Waiting up to 7200 seconds for tests to finish...
2021-01-05T13:58:20.390 INFO:teuthology.results:Tests finished! gathering results...
2021-01-05T13:58:20.516 INFO:scrape:Found 1 jobs
2021-01-05T13:58:20.570 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7808-g206cac3d (206cac3da96ecc9c89acdf345b6104a19b843407) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x7f7866634d40]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x5655095aa552]

2021-01-05T13:58:20.572 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-05T13:56:52.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
, 2021-01-05T13:56:53.093 INFO:teuthology.orchestra.run.smithi139.stdout:34359738417
, 2021-01-05T13:56:53.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738417 for osd.2

2021-01-05T13:58:20.573 WARNING:scrape:Ignoring malparsed backtrace:     next(self.gen)
,   File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/rados.py", line 277, in task
,     running.get()

2021-01-05T13:58:20.574 WARNING:scrape:Ignoring malparsed backtrace:     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status
,     raise CommandCrashedError(command=self.command)

2021-01-05T13:58:20.574 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__
,     self.gen.throw(type, value, traceback)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 393, in archive

2021-01-05T13:58:20.607 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7808-g206cac3d (206cac3da96ecc9c89acdf345b6104a19b843407) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x7f7866634d40]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x5655095aa552]

2021-01-05T13:58:20.609 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-05T13:56:52.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
, 2021-01-05T13:56:53.093 INFO:teuthology.orchestra.run.smithi139.stdout:34359738417
, 2021-01-05T13:56:53.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738417 for osd.2

2021-01-05T13:58:20.609 WARNING:scrape:Ignoring malparsed backtrace:     next(self.gen)
,   File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/rados.py", line 277, in task
,     running.get()

2021-01-05T13:58:20.610 WARNING:scrape:Ignoring malparsed backtrace:     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status
,     raise CommandCrashedError(command=self.command)

2021-01-05T13:58:20.610 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__
,     self.gen.throw(type, value, traceback)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 393, in archive

2021-01-05T13:58:20.639 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7808-g206cac3d (206cac3da96ecc9c89acdf345b6104a19b843407) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x7f7866634d40]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x5655095aa552]

2021-01-05T13:58:20.641 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-05T13:56:52.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
, 2021-01-05T13:56:53.093 INFO:teuthology.orchestra.run.smithi139.stdout:34359738417
, 2021-01-05T13:56:53.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738417 for osd.2

2021-01-05T13:58:20.642 WARNING:scrape:Ignoring malparsed backtrace:     next(self.gen)
,   File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/rados.py", line 277, in task
,     running.get()

2021-01-05T13:58:20.643 WARNING:scrape:Ignoring malparsed backtrace:     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status
,     raise CommandCrashedError(command=self.command)

2021-01-05T13:58:20.643 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__
,     self.gen.throw(type, value, traceback)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 393, in archive

2021-01-05T13:58:20.650 INFO:scrape:Found 1 distinct failure reasons
2021-01-05T13:58:20.650 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0'
2021-01-05T13:58:20.651 INFO:scrape:1 jobs: ['5756397']
2021-01-05T13:58:20.651 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects}']
2021-01-05T13:58:20.652 INFO:scrape:
2021-01-05T13:58:20.652 INFO:teuthology.results:Sending results to xxhdx1985126@gmail.com: Test Run: xuxuehan-2021-01-05_13:31:22-crimson-rados:thrash-wip-crimson-interruptible-future-sequencer-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/xuxuehan-2021-01-05_13:31:22-crimson-rados:thrash-wip-crimson-interruptible-future-sequencer-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/xuxuehan-2021-01-05_13:31:22-crimson-rados:thrash-wip-crimson-interruptible-future-sequencer-distro-basic-smithi/
failed:  1
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[5756397]  crimson-rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects}
-----------------------------------------------------------------
time:   00:08:54
info:   http://pulpito.ceph.com/xuxuehan-2021-01-05_13:31:22-crimson-rados:thrash-wip-crimson-interruptible-future-sequencer-distro-basic-smithi/5756397/
log:    http://qa-proxy.ceph.com/teuthology/xuxuehan-2021-01-05_13:31:22-crimson-rados:thrash-wip-crimson-interruptible-future-sequencer-distro-basic-smithi/5756397/

    Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000
    --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000
    --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op
    delete 10 --op write_excl 50 --pool unique_pool_0'