2021-01-16T01:08:49.756 INFO:root:teuthology version: 1.0.0-04fddc54 2021-01-16T01:08:49.757 INFO:teuthology.results:subset: '1/75000' 2021-01-16T01:08:49.758 INFO:teuthology.results:seed: '8198' 2021-01-16T06:19:11.534 INFO:root:teuthology version: 1.0.0-04fddc54 2021-01-16T06:19:11.582 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-16T18:15:36.420 INFO:teuthology.results:Tests finished! gathering results... 2021-01-16T18:16:33.426 INFO:scrape:Found 364 jobs 2021-01-16T18:16:40.783 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:40.785 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:40.785 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:40.786 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:40.891 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:40.892 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:40.893 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:40.894 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.011 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.013 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.014 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.014 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.119 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.121 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.121 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.122 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.227 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.228 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.229 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.230 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.374 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.376 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.377 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.377 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.480 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.482 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.483 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.483 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.594 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.596 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:41.700 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-9110-g174f7024 (174f7024c30497be3866b21627946f27bb06fa66) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdf3ec7509b] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x155f) [0x560d96f9ac2f] 2021-01-16T18:16:41.702 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:16:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-16T06:16:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: , dumped all 2021-01-16T18:16:41.703 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:17:10.393 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-16T06:17:10.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit , 2021-01-16T06:17:10.395 INFO:teuthology.orchestra.run:waiting for 300 2021-01-16T18:16:41.703 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-16T06:18:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2021-01-16T06:18:53.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-16T18:16:44.551 INFO:scrape:Found 10 distinct failure reasons 2021-01-16T18:16:44.553 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-16T18:16:44.554 INFO:scrape:6 jobs: ['5790147', '5789932', '5790059', '5790016', '5790238', '5789968'] 2021-01-16T18:16:44.554 INFO:scrape:suites intersection: [] 2021-01-16T18:16:44.555 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'clusters/{fixed-2', 'distro$/{centos_8.0}', 'distro$/{centos_latest}', 'distro$/{rhel_8.0}', 'fast/normal', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/cephadm/upgrade/{1-start', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-radosbench}'] 2021-01-16T18:16:44.556 INFO:scrape: 2021-01-16T18:16:44.556 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-01-16T18:16:44.557 INFO:scrape:2 jobs: ['5789943', '5790159'] 2021-01-16T18:16:44.557 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-16T18:16:44.558 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-16T18:16:44.558 INFO:scrape: 2021-01-16T18:16:44.559 INFO:scrape:Dead: b'2021-01-16T18:13:19.740 DEBUG:teuthology.exit:Finished running handlers' 2021-01-16T18:16:44.559 INFO:scrape:8 jobs: ['5790256', '5790235', '5790215', '5789982', '5790197', '5790229', '5789969', '5790121'] 2021-01-16T18:16:44.559 INFO:scrape:suites intersection: [] 2021-01-16T18:16:44.560 INFO:scrape:suites union: ['1-install/luminous', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/cephadm/smoke/{distro/centos_8.0', 'rados/cephadm/smoke/{distro/rhel_latest', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/objectstore/{backends/objectstore', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/lost-unfound-delete', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{default}', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/radosbench-high-concurrency}', 'workloads/snaps-few-objects}'] 2021-01-16T18:16:44.560 INFO:scrape: 2021-01-16T18:16:44.561 INFO:scrape:Failure: wait_for_recovery: failed before timeout expired 2021-01-16T18:16:44.561 INFO:scrape:5 jobs: ['5790069', '5790169', '5790164', '5790166', '5790158'] 2021-01-16T18:16:44.561 INFO:scrape:suites intersection: ['rados'] 2021-01-16T18:16:44.562 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'fast/fast', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/singleton/{all/recovery-preemption', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/small-objects}'] 2021-01-16T18:16:44.562 INFO:scrape: 2021-01-16T18:16:44.563 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi140 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=174f7024c30497be3866b21627946f27bb06fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-01-16T18:16:44.563 INFO:scrape:1 jobs: ['5789972'] 2021-01-16T18:16:44.564 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-16T18:16:44.564 INFO:scrape: 2021-01-16T18:16:44.564 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi205 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=174f7024c30497be3866b21627946f27bb06fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 2021-01-16T18:16:44.565 INFO:scrape:2 jobs: ['5790094', '5790184'] 2021-01-16T18:16:44.565 INFO:scrape:suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool'] 2021-01-16T18:16:44.566 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2021-01-16T18:16:44.566 INFO:scrape: 2021-01-16T18:16:44.566 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi171 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=174f7024c30497be3866b21627946f27bb06fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-01-16T18:16:44.567 INFO:scrape:2 jobs: ['5789921', '5790100'] 2021-01-16T18:16:44.567 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2021-01-16T18:16:44.568 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2021-01-16T18:16:44.568 INFO:scrape: 2021-01-16T18:16:44.569 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=174f7024c30497be3866b21627946f27bb06fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-16T18:16:44.569 INFO:scrape:2 jobs: ['5790005', '5790140'] 2021-01-16T18:16:44.569 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2021-01-16T18:16:44.570 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-16T18:16:44.570 INFO:scrape: 2021-01-16T18:16:44.571 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2021-01-16T18:16:44.571 INFO:scrape:1 jobs: ['5790231'] 2021-01-16T18:16:44.571 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}'] 2021-01-16T18:16:44.572 INFO:scrape: 2021-01-16T18:16:44.572 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=174f7024c30497be3866b21627946f27bb06fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh' 2021-01-16T18:16:44.573 INFO:scrape:2 jobs: ['5790248', '5790067'] 2021-01-16T18:16:44.573 INFO:scrape:suites intersection: ['supported-random-distro$/{rhel_8}', 'workloads/scrub}'] 2021-01-16T18:16:44.573 INFO:scrape:suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{rhel_8}', 'workloads/scrub}'] 2021-01-16T18:16:44.574 INFO:scrape: