2020-11-30T11:16:25.919 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-30T11:16:25.920 INFO:teuthology.results:subset: '1/100000' 2020-11-30T11:16:25.921 INFO:teuthology.results:seed: '1383' 2020-11-30T16:12:51.439 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-30T16:12:51.456 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-01T01:06:10.263 INFO:teuthology.results:Tests finished! gathering results... 2020-12-01T01:07:10.422 INFO:scrape:Found 367 jobs 2020-12-01T01:07:20.397 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:20.399 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:20.400 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:20.400 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:20.401 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:20.518 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:20.520 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:20.521 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:20.522 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:20.522 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:20.673 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:20.676 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:20.677 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:20.678 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:20.679 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:20.787 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:20.789 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:20.789 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:20.790 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:20.791 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:20.900 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:20.902 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:20.903 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:20.904 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:20.904 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.011 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.013 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.014 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.015 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.015 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.129 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.132 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.133 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.134 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.134 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.280 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.284 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.285 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.286 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.287 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.387 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.389 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.389 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.390 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.390 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.491 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.493 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.493 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.494 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.494 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.594 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.596 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.596 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.597 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.598 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.710 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.712 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.713 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.714 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.714 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.819 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7593-g1bfdd2c1 (1bfdd2c1c2baa364d9b61b5f73775162da787172) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f2813d465b2] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eb75134e76] 2020-12-01T01:07:21.821 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-30T16:05:45.551 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-30T16:05:45.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-12-01T01:07:21.821 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:07:07.917 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-30T16:07:07.933 INFO:tasks.ceph.mgr.x:Stopped , 2020-11-30T16:07:07.934 INFO:teuthology.misc:Shutting down mon daemons... 2020-12-01T01:07:21.822 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-30T16:09:11.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux , 2020-11-30T16:09:11.180 INFO:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log , 2020-11-30T16:09:11.232 INFO:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2020-12-01T01:07:21.822 WARNING:scrape:Ignoring malparsed backtrace: teuthology.exceptions.CommandFailedError: Command failed on smithi162 with status 1: 'sudo cp /usr/bin/ceph_test_rados.debug /tmp/tmp.SzbdVM0jX6' , 2020-11-30T16:09:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2020-11-30T16:09:22.149 INFO:teuthology.task.internal:Not uploading archives. 2020-12-01T01:07:21.996 INFO:scrape:Found 13 distinct failure reasons 2020-12-01T01:07:21.997 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2020-12-01T01:07:21.997 INFO:scrape:1 jobs: ['5669141'] 2020-12-01T01:07:21.998 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-12-01T01:07:21.998 INFO:scrape: 2020-12-01T01:07:21.999 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-12-01T01:07:21.999 INFO:scrape:2 jobs: ['5669064', '5668838'] 2020-12-01T01:07:21.999 INFO:scrape:suites intersection: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'rados/monthrash/{ceph', 'workloads/rados_mon_workunits}'] 2020-12-01T01:07:22.000 INFO:scrape:suites union: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-stupid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'thrashers/many', 'workloads/rados_mon_workunits}'] 2020-12-01T01:07:22.000 INFO:scrape: 2020-12-01T01:07:22.001 INFO:scrape:Failure: Command failed (workunit test mon/mon-last-epoch-clean.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh' 2020-12-01T01:07:22.001 INFO:scrape:1 jobs: ['5669131'] 2020-12-01T01:07:22.002 INFO:scrape:suites: ['rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{centos_8}', 'workloads/mon}'] 2020-12-01T01:07:22.002 INFO:scrape: 2020-12-01T01:07:22.003 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi065 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-12-01T01:07:22.003 INFO:scrape:2 jobs: ['5668852', '5669034'] 2020-12-01T01:07:22.004 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-01T01:07:22.004 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-01T01:07:22.004 INFO:scrape: 2020-12-01T01:07:22.005 INFO:scrape:Failure: Command failed on smithi058 with status 1: '/home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml' 2020-12-01T01:07:22.005 INFO:scrape:1 jobs: ['5669114'] 2020-12-01T01:07:22.006 INFO:scrape:suites: ['mon_election/classic', 'objectstore/bluestore-comp', 'openstack', 'rados/perf/{ceph', 'scheduler/dmclock_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/sample_fio}'] 2020-12-01T01:07:22.006 INFO:scrape: 2020-12-01T01:07:22.006 INFO:scrape:Failure: Command failed on smithi205 with status 5: 'sudo systemctl stop ceph-94a0d8e2-3312-11eb-980d-001a4aab830c@mon.a' 2020-12-01T01:07:22.007 INFO:scrape:4 jobs: ['5668946', '5669137', '5669048', '5669176'] 2020-12-01T01:07:22.007 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-12-01T01:07:22.008 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-01T01:07:22.008 INFO:scrape: 2020-12-01T01:07:22.008 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2020-12-01T01:07:22.009 INFO:scrape:2 jobs: ['5669033', '5669174'] 2020-12-01T01:07:22.009 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/centos_latest', 'task/test_adoption}'] 2020-12-01T01:07:22.010 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'task/test_adoption}'] 2020-12-01T01:07:22.010 INFO:scrape: 2020-12-01T01:07:22.010 INFO:scrape:Dead: b'2020-12-01T01:03:50.539 DEBUG:teuthology.exit:Finished running handlers' 2020-12-01T01:07:22.011 INFO:scrape:1 jobs: ['5668917'] 2020-12-01T01:07:22.011 INFO:scrape:suites: ['1-install/nautilus-v2only', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/connectivity', 'msgr-failures/fastclose', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}'] 2020-12-01T01:07:22.012 INFO:scrape: 2020-12-01T01:07:22.012 INFO:scrape:Failure: Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6f5bbe0-3310-11eb-980d-001a4aab830c -- ceph orch host add smithi146' 2020-12-01T01:07:22.012 INFO:scrape:1 jobs: ['5668904'] 2020-12-01T01:07:22.013 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-01T01:07:22.013 INFO:scrape: 2020-12-01T01:07:22.014 INFO:scrape:Failure: Command failed on smithi171 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:1bfdd2c1c2baa364d9b61b5f73775162da787172 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08ffcccc-3311-11eb-980d-001a4aab830c -- ceph orch daemon add mon smithi171:172.21.15.171=smithi171' 2020-12-01T01:07:22.014 INFO:scrape:2 jobs: ['5668936', '5669192'] 2020-12-01T01:07:22.015 INFO:scrape:suites intersection: ['start}'] 2020-12-01T01:07:22.015 INFO:scrape:suites union: ['rados/cephadm/smoke-roleless/{distro/rhel_latest', 'rados/cephadm/smoke-roleless/{distro/ubuntu_latest', 'start}'] 2020-12-01T01:07:22.015 INFO:scrape: 2020-12-01T01:07:22.016 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-12-01T01:07:22.016 INFO:scrape:2 jobs: ['5669074', '5668937'] 2020-12-01T01:07:22.017 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2020-12-01T01:07:22.017 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-12-01T01:07:22.017 INFO:scrape: 2020-12-01T01:07:22.018 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-12-01T01:07:22.018 INFO:scrape:1 jobs: ['5668992'] 2020-12-01T01:07:22.018 INFO:scrape:suites: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-01T01:07:22.019 INFO:scrape: 2020-12-01T01:07:22.019 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-12-01T01:07:22.020 INFO:scrape:1 jobs: ['5669166'] 2020-12-01T01:07:22.020 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2020-12-01T01:07:22.021 INFO:scrape: 2020-12-01T01:07:22.033 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/ failed: 20 dead: 1 running: 0 waiting: 0 queued: 0 passed: 346 Fail ================================================================= [5668838] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:19:26 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668838/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668838/ sentry: https://sentry.ceph.com/organizations/ceph/?query=202bf2ea37b842a3972785af38247906 Command failed (workunit test mon/caps.sh) on smithi136 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5668852] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668852/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668852/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e057a9b766584564a425b220e57d7822 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi065 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5668904] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668904/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668904/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da263323d443428897c3737f336ebd9f Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6f5bbe0-3310-11eb-980d-001a4aab830c -- ceph orch host add smithi146' [5668936] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668936/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668936/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b867ea179cf46c194b8d47b056d7e31 Command failed on smithi171 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:1bfdd2c1c2baa364d9b61b5f73775162da787172 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08ffcccc-3311-11eb-980d-001a4aab830c -- ceph orch daemon add mon smithi171:172.21.15.171=smithi171' [5668937] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668937/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668937/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7cc93ad12f0f425bb33fbd63f3faec38 Command failed (workunit test cephadm/test_cephadm.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5668946] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:02:12 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668946/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668946/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c60a57c63c8c4b999731935abd54e39e Command failed on smithi205 with status 5: 'sudo systemctl stop ceph-94a0d8e2-3312-11eb-980d-001a4aab830c@mon.a' [5668992] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668992/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668992/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f37b1f4449744a8b4a18e95237cce02 reached maximum tries (180) after waiting for 180 seconds [5669033] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669033/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669033/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c28e6facb694cc3a4392131874ee95b Command failed (workunit test cephadm/test_adoption.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5669034] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669034/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669034/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b6c2cfde64a42d2b83df90d6d9a0abd Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5669048] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669048/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669048/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d862364e044044f08eca12754665f380 Command failed on smithi074 with status 5: 'sudo systemctl stop ceph-33d048c8-331b-11eb-980d-001a4aab830c@mon.a' [5669064] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:18:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669064/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669064/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efe06e2c92394720961519d49e0e6c29 Command failed (workunit test mon/caps.sh) on smithi027 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5669074] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669074/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49796d28cbbf4a46b1cad4b6758388d5 Command failed (workunit test cephadm/test_cephadm.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5669114] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} ----------------------------------------------------------------- time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669114/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce9c2d74e3934ca49bef9ccbea991cbb Command failed on smithi058 with status 1: '/home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml' [5669131] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mon} ----------------------------------------------------------------- time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669131/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669131/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d9ed07ba4bf4c78a6ae49deabbf8838 Command failed (workunit test mon/mon-last-epoch-clean.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch- clean.sh' [5669137] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:02:05 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669137/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669137/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31f13a447cef4a5d8dfb673d1fb3bb2e Command failed on smithi144 with status 5: 'sudo systemctl stop ceph-098ef2d2-3323-11eb-980d-001a4aab830c@mon.a' [5669141] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669141/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669141/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ff18473d54b4023935e6d3e962d7f4d Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [5669166] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669166/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669166/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5669174] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669174/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669174/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0147afb1c1b5494d87496056b1f9a54a Command failed (workunit test cephadm/test_adoption.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bfdd2c1c2baa364d9b61b5f73775162da787172 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5669176] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:02:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669176/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669176/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17574e24cc8e43f597591e26f59880f0 Command failed on smithi116 with status 5: 'sudo systemctl stop ceph-15a61c46-3326-11eb-980d-001a4aab830c@mon.a' [5669192] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:55:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669192/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2077162cec0f43128bb2c8453ac14624 Command failed on smithi179 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:1bfdd2c1c2baa364d9b61b5f73775162da787172 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24dce39c-3327-11eb-980d-001a4aab830c -- ceph mon dump -f json' Dead ================================================================= [5668917] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668917/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668917/ Pass ================================================================= [5668831] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668831/ [5668832] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668832/ [5668833] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:32 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668833/ [5668834] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668834/ [5668835] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:05:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668835/ [5668836] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:34:56 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668836/ [5668837] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668837/ [5668839] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:39:22 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668839/ [5668840] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:57 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668840/ [5668841] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668841/ [5668842] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668842/ [5668843] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:37:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668843/ [5668844] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:03:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668844/ [5668845] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668845/ [5668846] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668846/ [5668847] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668847/ [5668848] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668848/ [5668849] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:01:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668849/ [5668850] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668850/ [5668851] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:36:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668851/ [5668853] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668853/ [5668854] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:09:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668854/ [5668855] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668855/ [5668856] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668856/ [5668857] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668857/ [5668858] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668858/ [5668859] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668859/ [5668860] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/progress} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668860/ [5668861] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668861/ [5668862] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:05:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668862/ [5668863] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 02:24:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668863/ [5668864] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668864/ [5668865] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668865/ [5668866] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668866/ [5668867] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668867/ [5668868] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:37:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668868/ [5668869] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668869/ [5668870] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668870/ [5668871] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668871/ [5668872] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668872/ [5668873] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:49:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668873/ [5668874] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668874/ [5668875] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668875/ [5668876] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668876/ [5668877] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668877/ [5668878] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668878/ [5668879] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 01:56:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668879/ [5668880] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:35:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668880/ [5668881] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668881/ [5668882] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668882/ [5668883] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:48:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668883/ [5668884] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668884/ [5668885] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668885/ [5668886] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668886/ [5668887] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668887/ [5668888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668888/ [5668889] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668889/ [5668890] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668890/ [5668891] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:33:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668891/ [5668892] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668892/ [5668893] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668893/ [5668894] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:20:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668894/ [5668895] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668895/ [5668896] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668896/ [5668897] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668897/ [5668898] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668898/ [5668899] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:35:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668899/ [5668900] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668900/ [5668901] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668901/ [5668902] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:52:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668902/ [5668903] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:10:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668903/ [5668905] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668905/ [5668906] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668906/ [5668907] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668907/ [5668908] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668908/ [5668909] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668909/ [5668910] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668910/ [5668911] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668911/ [5668912] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668912/ [5668913] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:07:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668913/ [5668914] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668914/ [5668915] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:40:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668915/ [5668916] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668916/ [5668918] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668918/ [5668919] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668919/ [5668920] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668920/ [5668921] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668921/ [5668922] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/misc} time: 00:31:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668922/ [5668923] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:05:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668923/ [5668924] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:25:42 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668924/ [5668925] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668925/ [5668926] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668926/ [5668927] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668927/ [5668928] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668928/ [5668929] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668929/ [5668930] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668930/ [5668931] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668931/ [5668932] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668932/ [5668933] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668933/ [5668934] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668934/ [5668935] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:37:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668935/ [5668938] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668938/ [5668939] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668939/ [5668940] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668940/ [5668941] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668941/ [5668942] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668942/ [5668943] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668943/ [5668944] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668944/ [5668945] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:25:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668945/ [5668947] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:12 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668947/ [5668948] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:46:48 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668948/ [5668949] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668949/ [5668950] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668950/ [5668951] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668951/ [5668952] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668952/ [5668953] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668953/ [5668954] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668954/ [5668955] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:11 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668955/ [5668956] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668956/ [5668957] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668957/ [5668958] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668958/ [5668959] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668959/ [5668960] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668960/ [5668961] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668961/ [5668962] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:34:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668962/ [5668963] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668963/ [5668964] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/crash} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668964/ [5668965] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668965/ [5668966] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:28:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668966/ [5668967] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668967/ [5668968] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668968/ [5668969] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668969/ [5668970] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668970/ [5668971] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668971/ [5668972] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668972/ [5668973] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:11:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668973/ [5668974] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668974/ [5668975] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668975/ [5668976] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668976/ [5668977] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668977/ [5668978] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668978/ [5668979] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668979/ [5668980] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668980/ [5668981] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668981/ [5668982] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668982/ [5668983] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668983/ [5668984] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668984/ [5668985] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:08:32 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668985/ [5668986] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668986/ [5668987] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668987/ [5668988] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668988/ [5668989] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668989/ [5668990] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668990/ [5668991] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668991/ [5668993] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668993/ [5668994] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668994/ [5668995] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668995/ [5668996] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:29:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668996/ [5668997] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668997/ [5668998] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668998/ [5668999] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5668999/ [5669000] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/scrub} time: 01:41:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669000/ [5669001] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669001/ [5669002] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669002/ [5669003] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669003/ [5669004] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669004/ [5669005] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669005/ [5669006] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:06:36 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669006/ [5669007] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:15:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669007/ [5669008] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:26:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669008/ [5669009] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669009/ [5669010] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669010/ [5669011] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669011/ [5669012] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669012/ [5669013] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669013/ [5669014] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669014/ [5669015] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669015/ [5669016] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:14:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669016/ [5669017] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669017/ [5669018] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669018/ [5669019] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669019/ [5669020] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669020/ [5669021] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669021/ [5669022] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669022/ [5669023] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669023/ [5669024] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:48:20 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669024/ [5669025] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:36:32 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669025/ [5669026] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:06:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669026/ [5669027] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669027/ [5669028] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:37:13 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669028/ [5669029] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669029/ [5669030] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669030/ [5669031] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669031/ [5669032] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:11:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669032/ [5669035] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669035/ [5669036] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/insights} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669036/ [5669037] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669037/ [5669038] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669038/ [5669039] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669039/ [5669040] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669040/ [5669041] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669041/ [5669042] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669042/ [5669043] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669043/ [5669044] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669044/ [5669045] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669045/ [5669046] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669046/ [5669047] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669047/ [5669049] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669049/ [5669050] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669050/ [5669051] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:37:50 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669051/ [5669052] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669052/ [5669053] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669053/ [5669054] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669054/ [5669055] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669055/ [5669056] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669056/ [5669057] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669057/ [5669058] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669058/ [5669059] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669059/ [5669060] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669060/ [5669061] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669061/ [5669062] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669062/ [5669063] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669063/ [5669065] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669065/ [5669066] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669066/ [5669067] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669067/ [5669068] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669068/ [5669069] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669069/ [5669070] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669070/ [5669071] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669071/ [5669072] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669072/ [5669073] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669073/ [5669075] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669075/ [5669076] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669076/ [5669077] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669077/ [5669078] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669078/ [5669079] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669079/ [5669080] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669080/ [5669081] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669081/ [5669082] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669082/ [5669083] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669083/ [5669084] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669084/ [5669085] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669085/ [5669086] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669086/ [5669087] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669087/ [5669088] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:29:17 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669088/ [5669089] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:18 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669089/ [5669090] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669090/ [5669091] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669091/ [5669092] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} time: 00:50:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669092/ [5669093] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:22 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669093/ [5669094] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:15 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669094/ [5669095] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669095/ [5669096] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669096/ [5669097] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669097/ [5669098] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:36:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669098/ [5669099] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669099/ [5669100] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669100/ [5669101] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:26:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669101/ [5669102] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669102/ [5669103] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669103/ [5669104] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669104/ [5669105] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/progress} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669105/ [5669106] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:30:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669106/ [5669107] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669107/ [5669108] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:06:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669108/ [5669109] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669109/ [5669110] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669110/ [5669111] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669111/ [5669112] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:47:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669112/ [5669113] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669113/ [5669115] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669115/ [5669116] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669116/ [5669117] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669117/ [5669118] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:37:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669118/ [5669119] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669119/ [5669120] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669120/ [5669121] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669121/ [5669122] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669122/ [5669123] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:32:57 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669123/ [5669124] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669124/ [5669125] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669125/ [5669126] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669126/ [5669127] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669127/ [5669128] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:11 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669128/ [5669129] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669129/ [5669130] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669130/ [5669132] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669132/ [5669133] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:05:55 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669133/ [5669134] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:34:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669134/ [5669135] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669135/ [5669136] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669136/ [5669138] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669138/ [5669139] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669139/ [5669140] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 01:02:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669140/ [5669142] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669142/ [5669143] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669143/ [5669144] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669144/ [5669145] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669145/ [5669146] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669146/ [5669147] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:33:57 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669147/ [5669148] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669148/ [5669149] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:06:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669149/ [5669150] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:36:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669150/ [5669151] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:29:14 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669151/ [5669152] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669152/ [5669153] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669153/ [5669154] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:58 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669154/ [5669155] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:12:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669155/ [5669156] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669156/ [5669157] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669157/ [5669158] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669158/ [5669159] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669159/ [5669160] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669160/ [5669161] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669161/ [5669162] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 02:09:40 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669162/ [5669163] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:42 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669163/ [5669164] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669164/ [5669165] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669165/ [5669167] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:06:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669167/ [5669168] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:00:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669168/ [5669169] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669169/ [5669170] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} time: 01:29:06 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669170/ [5669171] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669171/ [5669172] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669172/ [5669173] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669173/ [5669175] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669175/ [5669177] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669177/ [5669178] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669178/ [5669179] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:44 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669179/ [5669180] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:07 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669180/ [5669181] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669181/ [5669182] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:40:39 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669182/ [5669183] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669183/ [5669184] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669184/ [5669185] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669185/ [5669186] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669186/ [5669187] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:07:19 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669187/ [5669188] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:06:28 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669188/ [5669189] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669189/ [5669190] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:14:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669190/ [5669191] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669191/ [5669193] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669193/ [5669194] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669194/ [5669195] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669195/ [5669196] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:09 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669196/ [5669197] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-11-30_07:01:02-rados-master-distro-basic-smithi/5669197/