Found 1 jobs Ignoring malparsed backtrace: ceph version 17.0.0-1645-ge3d3cdd2 (e3d3cdd2f9a61ff22f9828d81f0c0dd9bc3cc60b) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7fe683175638] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x55abf9304552] Ignoring malparsed backtrace: 2021-03-08T05:27:12.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2021-03-08T05:27:12.986 INFO:teuthology.orchestra.run.smithi079.stdout:34359738398 , 2021-03-08T05:27:12.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738398 for osd.3 Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 829, in gevent._gevent_cgreenlet.Greenlet.get , File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise Ignoring malparsed backtrace: teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' , 2021-03-08T05:27:40.795 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-03-08T05:27:40.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits Ignoring malparsed backtrace: fetch_binaries_for_coredumps(path, rem) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/task/internal/__init__.py", line 318, in fetch_binaries_for_coredumps , dump_program = dump_out.split("from '")[1].split(' ')[0] Ignoring malparsed backtrace: ceph version 17.0.0-1645-ge3d3cdd2 (e3d3cdd2f9a61ff22f9828d81f0c0dd9bc3cc60b) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7fe683175638] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x55abf9304552] Ignoring malparsed backtrace: 2021-03-08T05:27:12.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2021-03-08T05:27:12.986 INFO:teuthology.orchestra.run.smithi079.stdout:34359738398 , 2021-03-08T05:27:12.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738398 for osd.3 Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 829, in gevent._gevent_cgreenlet.Greenlet.get , File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise Ignoring malparsed backtrace: teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' , 2021-03-08T05:27:40.795 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-03-08T05:27:40.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits Ignoring malparsed backtrace: fetch_binaries_for_coredumps(path, rem) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/task/internal/__init__.py", line 318, in fetch_binaries_for_coredumps , dump_program = dump_out.split("from '")[1].split(' ')[0] Ignoring malparsed backtrace: ceph version 17.0.0-1645-ge3d3cdd2 (e3d3cdd2f9a61ff22f9828d81f0c0dd9bc3cc60b) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7fe683175638] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6e2) [0x55abf9304552] Ignoring malparsed backtrace: 2021-03-08T05:27:12.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2021-03-08T05:27:12.986 INFO:teuthology.orchestra.run.smithi079.stdout:34359738398 , 2021-03-08T05:27:12.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738398 for osd.3 Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 829, in gevent._gevent_cgreenlet.Greenlet.get , File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise Ignoring malparsed backtrace: teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' , 2021-03-08T05:27:40.795 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-03-08T05:27:40.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits Ignoring malparsed backtrace: fetch_binaries_for_coredumps(path, rem) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/task/internal/__init__.py", line 318, in fetch_binaries_for_coredumps , dump_program = dump_out.split("from '")[1].split(' ')[0] Found 1 distinct failure reasons Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' 1 jobs: ['5946105'] suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects}']