2020-10-13T01:56:51.976 INFO:root:teuthology version: 1.0.0-b106d09 2020-10-13T01:56:51.977 INFO:teuthology.results:subset: '912/9999' 2020-10-13T01:56:51.977 INFO:teuthology.results:seed: '2477' 2020-10-13T15:18:29.510 INFO:root:teuthology version: 1.0.0-b106d09 2020-10-13T15:18:29.560 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-13T20:40:43.347 INFO:teuthology.results:Tests finished! gathering results... 2020-10-13T20:41:31.285 INFO:scrape:Found 446 jobs 2020-10-13T20:41:36.161 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.164 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.164 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.165 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.165 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.289 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.292 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.292 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.293 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.416 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.419 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.419 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.420 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.420 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.548 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.550 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.551 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.551 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.552 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.675 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.678 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.679 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.679 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.679 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.802 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.804 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.805 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.805 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.806 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:36.942 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:36.944 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:36.945 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:36.945 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:36.946 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:37.068 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:37.070 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:37.071 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:37.072 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:37.072 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:37.202 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:37.205 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:37.205 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:37.206 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:37.206 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:37.330 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:37.333 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:37.333 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:37.334 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:37.335 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:37.459 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6303-g9e1c5bcf (9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fb600cedf16] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56074f875ca6] 2020-10-13T20:41:37.461 WARNING:scrape:Ignoring malparsed backtrace: 2020-10-13T14:00:41.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 , instructed osd(s) 5 to deep-scrub , 2020-10-13T14:00:41.972 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-13T20:41:37.462 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait , self._raise_for_status() , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 178, in _raise_for_status 2020-10-13T20:41:37.462 WARNING:scrape:Ignoring malparsed backtrace: File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2020-10-13T20:41:37.463 WARNING:scrape:Ignoring malparsed backtrace: next(self.gen) , File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-10-12-1615/qa/tasks/rados.py", line 277, in task , running.get() 2020-10-13T20:41:41.897 INFO:scrape:Found 11 distinct failure reasons 2020-10-13T20:41:41.899 INFO:scrape:Failure: Command failed (workunit test rados/test_python.sh) on smithi149 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' 2020-10-13T20:41:41.899 INFO:scrape:5 jobs: ['5520976', '5521056', '5521270', '5521209', '5521094'] 2020-10-13T20:41:41.900 INFO:scrape:suites intersection: ['tasks/rados_python}'] 2020-10-13T20:41:41.900 INFO:scrape:suites union: ['clusters/{fixed-2', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'start', 'supported-random-distro$/{centos_8}', 'tasks/rados_python}'] 2020-10-13T20:41:41.900 INFO:scrape: 2020-10-13T20:41:41.901 INFO:scrape:Failure: Command failed on smithi145 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt -y install podman'" 2020-10-13T20:41:41.901 INFO:scrape:11 jobs: ['5521292', '5521304', '5521027', '5521123', '5521189', '5521181', '5521288', '5521019', '5521104', '5521011', '5520909'] 2020-10-13T20:41:41.901 INFO:scrape:suites intersection: [] 2020-10-13T20:41:41.902 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/objectstore/{backends/filestore-idempotent', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/pg-removal-interruption', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'task/test_adoption}', 'task/test_orch_cli}', 'tasks/crash}', 'tasks/dashboard}', 'thrashers/careful', 'thrashers/default', 'thrashers/none', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/small-objects-localized}', 'workloads/snaps-few-objects-balanced}'] 2020-10-13T20:41:41.902 INFO:scrape: 2020-10-13T20:41:41.902 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-10-13T20:41:41.903 INFO:scrape:2 jobs: ['5521213', '5520990'] 2020-10-13T20:41:41.903 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-10-13T20:41:41.903 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-10-13T20:41:41.903 INFO:scrape: 2020-10-13T20:41:41.904 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-10-13T20:41:41.904 INFO:scrape:1 jobs: ['5521262'] 2020-10-13T20:41:41.904 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2020-10-13T20:41:41.905 INFO:scrape: 2020-10-13T20:41:41.905 INFO:scrape:Failure: SSH connection to smithi073 was lost: 'sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart' 2020-10-13T20:41:41.905 INFO:scrape:2 jobs: ['5521224', '5521254'] 2020-10-13T20:41:41.905 INFO:scrape:suites intersection: ['mon_election/classic', 'msgr/async-v1only', 'rados'] 2020-10-13T20:41:41.906 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/classic', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/singleton/{all/ec-lost-unfound', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}'] 2020-10-13T20:41:41.906 INFO:scrape: 2020-10-13T20:41:41.906 INFO:scrape:Failure: {'Failure object was': {'smithi112.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} 2020-10-13T20:41:41.907 INFO:scrape:13 jobs: ['5521133', '5521112', '5521187', '5521130', '5520954', '5521129', '5520950', '5521106', '5521132', '5521025', '5521124', '5521201', '5521233'] 2020-10-13T20:41:41.907 INFO:scrape:suites intersection: [] 2020-10-13T20:41:41.907 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-inject-leak/none', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'centos_latest}', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'd-thrash/default/{default', 'fast/normal', 'fixed-2', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/smoke/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/objectstore/{backends/filestore-idempotent-aio-journal', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'start', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'task/test_orch_cli}', 'tasks/mon_recovery', 'tasks/rados_api_tests}', 'tasks/rados_stress_watch}', 'tasks/rados_workunit_loadgen_big}', 'thrashers/careful', 'thrashers/default', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'thrashosds-health}', 'validater/lockdep}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-small-objects-balanced}', 'workloads/snaps-few-objects-balanced}'] 2020-10-13T20:41:41.908 INFO:scrape: 2020-10-13T20:41:41.908 INFO:scrape:Failure: {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'Data could not be sent to remote host "smithi121.front.sepia.ceph.com". Make sure this host can be reached over ssh: Warning: Permanently added \'smithi121.front.sepia.ceph.com,172.21.15.121\' (ECDSA) to the list of known hosts.\r\nubuntu@smithi121.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).\r\n', 'unreachable': True}} 2020-10-13T20:41:41.908 INFO:scrape:2 jobs: ['5521240', '5521221'] 2020-10-13T20:41:41.909 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr/async', 'rados'] 2020-10-13T20:41:41.909 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/singleton/{all/dump-stuck', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/write_fadvise_dontneed}'] 2020-10-13T20:41:41.909 INFO:scrape: 2020-10-13T20:41:41.910 INFO:scrape:Failure: Stale jobs detected, aborting. 2020-10-13T20:41:41.910 INFO:scrape:1 jobs: ['5521198'] 2020-10-13T20:41:41.910 INFO:scrape:suites: ['1-install/mimic', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2020-10-13T20:41:41.911 INFO:scrape: 2020-10-13T20:41:41.911 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-10-13T20:41:41.911 INFO:scrape:1 jobs: ['5521163'] 2020-10-13T20:41:41.912 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{rhel_8}}'] 2020-10-13T20:41:41.912 INFO:scrape: 2020-10-13T20:41:41.912 INFO:scrape:Failure: Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi185 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh' 2020-10-13T20:41:41.912 INFO:scrape:1 jobs: ['5521174'] 2020-10-13T20:41:41.913 INFO:scrape:suites: ['rados/standalone/{mon_election/classic', 'supported-random-distro$/{ubuntu_latest}', 'workloads/scrub}'] 2020-10-13T20:41:41.913 INFO:scrape: 2020-10-13T20:41:41.913 INFO:scrape:Failure: Test failure: test_osd_cannot_recover (tasks.mgr.test_progress.TestProgress) 2020-10-13T20:41:41.914 INFO:scrape:1 jobs: ['5521081'] 2020-10-13T20:41:41.914 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'objectstore/bluestore-comp-snappy', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/progress}'] 2020-10-13T20:41:41.914 INFO:scrape: 2020-10-13T20:41:41.931 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/ failed: 24 dead: 16 running: 0 waiting: 0 queued: 0 passed: 406 Fail ================================================================= [5520909] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520909/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520909/ sentry: https://sentry.ceph.com/sentry/sepia/?query=dee7d3c502f7482f8b8003913df7ea3f Command failed on smithi041 with status 1: 'sudo yum install -y kernel' [5520976] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:20:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520976/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520976/ sentry: https://sentry.ceph.com/sentry/sepia/?query=c9e5190070a44b598bfcfc32e5a8369b Command failed (workunit test rados/test_python.sh) on smithi149 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5520990] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:24:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520990/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520990/ sentry: https://sentry.ceph.com/sentry/sepia/?query=0528bd6299ca4e34a3a7fccb64483edd Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5521011] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521011/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521011/ sentry: https://sentry.ceph.com/sentry/sepia/?query=2c3ede823d8847d9a9de3489478ac621 Command failed on smithi186 with status 1: 'sudo yum -y install ceph-test' [5521019] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521019/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521019/ sentry: https://sentry.ceph.com/sentry/sepia/?query=b1e823748ec64a659536de5b13f65621 Command failed on smithi132 with status 1: 'sudo yum -y install ceph-test' [5521027] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:05:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521027/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521027/ sentry: https://sentry.ceph.com/sentry/sepia/?query=1ec81b262dbf43688b046bfa00831e33 Command failed on smithi035 with status 1: 'sudo yum -y install ceph- radosgw' [5521056] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:24:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521056/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521056/ sentry: https://sentry.ceph.com/sentry/sepia/?query=ef56059dd0cb48798a70013ded31de70 Command failed (workunit test rados/test_python.sh) on smithi058 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5521081] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/progress} ----------------------------------------------------------------- time: 00:10:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521081/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521081/ sentry: https://sentry.ceph.com/sentry/sepia/?query=5bb375f105714926a0e54ef88aa3f2fa Test failure: test_osd_cannot_recover (tasks.mgr.test_progress.TestProgress) [5521094] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:13:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521094/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521094/ sentry: https://sentry.ceph.com/sentry/sepia/?query=70f67ce736e34b5f99f68a9d29795843 Command failed (workunit test rados/test_python.sh) on smithi172 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5521104] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521104/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521104/ sentry: https://sentry.ceph.com/sentry/sepia/?query=729015b64b3243708e9d731392dd8cad Command failed on smithi196 with status 1: 'sudo yum -y install ceph-test' [5521123] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521123/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521123/ sentry: https://sentry.ceph.com/sentry/sepia/?query=767ecd922e204901959a201ca8645d28 Command failed on smithi196 with status 1: 'sudo yum install -y kernel' [5521163] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:27:44 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521163/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521163/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5521174] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} ----------------------------------------------------------------- time: 00:12:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521174/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521174/ sentry: https://sentry.ceph.com/sentry/sepia/?query=ae3a3c71dbb440cebe086426b24eb522 Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi185 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery- scrub.sh' [5521181] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:09:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521181/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521181/ sentry: https://sentry.ceph.com/sentry/sepia/?query=702531070adf4c1ab8bc8746e5f5bebc Command failed on smithi186 with status 1: 'sudo yum -y install ceph- radosgw' [5521189] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521189/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521189/ sentry: https://sentry.ceph.com/sentry/sepia/?query=32f7e98a07b84ec28ee5bec51d16f444 Command failed on smithi164 with status 1: 'sudo yum install -y kernel' [5521198] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521198/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521198/ sentry: https://sentry.ceph.com/sentry/sepia/?query=d80c5709eeaa4c66a09b291ec494c664 Stale jobs detected, aborting. [5521209] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:20:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521209/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521209/ sentry: https://sentry.ceph.com/sentry/sepia/?query=d8c0e16f406540ed8b1a1b68394eceb3 Command failed (workunit test rados/test_python.sh) on smithi175 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5521213] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:24:32 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521213/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521213/ sentry: https://sentry.ceph.com/sentry/sepia/?query=1352d16cb1a74deda61670526633dff7 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5521240] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521240/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521240/ sentry: https://sentry.ceph.com/sentry/sepia/?query=cbcf50a6f69b42b18975168e5c7eb5a1 {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'Data could not be sent to remote host "smithi121.front.sepia.ceph.com". Make sure this host can be reached over ssh: Warning: Permanently added \'smithi121.front.sepia.ceph.com,172.21.15.121\' (ECDSA) to the list of known hosts.\r\nubuntu@smithi121.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).\r\n', 'unreachable': True}} [5521262] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:24:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521262/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521262/ sentry: https://sentry.ceph.com/sentry/sepia/?query=796c07e9b8564b52b6451dc22ae25de2 Command failed (workunit test rados/test.sh) on smithi166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5521270] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521270/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521270/ sentry: https://sentry.ceph.com/sentry/sepia/?query=6ac1ede426c04a3286235dd66135cb32 Command failed (workunit test rados/test_python.sh) on smithi037 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9e1c5bcfeb1da945c6b2b0ae7f8018d39848642a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5521288] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521288/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521288/ sentry: https://sentry.ceph.com/sentry/sepia/?query=66e3be0914e8472ba0a2a6747d1b715c Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test' [5521292] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521292/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521292/ sentry: https://sentry.ceph.com/sentry/sepia/?query=0f02854a8d5f40ca98cfd0918dd6198c Command failed on smithi145 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt -y install podman'" [5521304] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521304/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521304/ sentry: https://sentry.ceph.com/sentry/sepia/?query=0d48d3e91e9c40d29d4563980412c152 Command failed on smithi141 with status 1: 'sudo yum install -y kernel' Dead ================================================================= [5520950] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:02:31 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520950/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520950/ sentry: https://sentry.ceph.com/sentry/sepia/?query=827ec09147f240ebb2a844afca6a417b {'Failure object was': {'smithi168.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5520954] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:02:31 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520954/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520954/ sentry: https://sentry.ceph.com/sentry/sepia/?query=e5073b2050dd42659aa6e3b4e22f8a29 {'Failure object was': {'smithi159.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521025] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:03:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521025/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521025/ sentry: https://sentry.ceph.com/sentry/sepia/?query=ce033fd6ff72409da0e04dce4ad27f48 {'Failure object was': {'smithi068.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521106] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521106/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521106/ sentry: https://sentry.ceph.com/sentry/sepia/?query=ab836d4dcb454b26aaf3265fe0c93c75 {'Failure object was': {'smithi129.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-program- options-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521112] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521112/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521112/ sentry: https://sentry.ceph.com/sentry/sepia/?query=fc5ee17cd1374449a06c5e4ff0a60079 {'Failure object was': {'smithi035.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521124] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:03:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521124/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521124/ sentry: https://sentry.ceph.com/sentry/sepia/?query=a844587193804e5b970d55533ed86478 {'Failure object was': {'smithi132.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521129] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521129/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521129/ sentry: https://sentry.ceph.com/sentry/sepia/?query=08e65122713c43f6982264b62aef32a7 {'Failure object was': {'smithi141.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521130] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:03:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521130/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521130/ sentry: https://sentry.ceph.com/sentry/sepia/?query=4ece8cd98a8d4b00b46b7a09a07ddbb4 {'Failure object was': {'smithi002.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521132] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:02:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521132/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521132/ sentry: https://sentry.ceph.com/sentry/sepia/?query=fbb9dd7051d04c66aa7a3b13847044ff {'Failure object was': {'smithi074.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521133] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:02:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521133/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521133/ sentry: https://sentry.ceph.com/sentry/sepia/?query=6bedb236a7944020ae862e4c0e69d701 {'Failure object was': {'smithi112.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521187] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:04:34 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521187/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521187/ sentry: https://sentry.ceph.com/sentry/sepia/?query=8667c03847cb4773af0ea5c5868ec312 {'Failure object was': {'smithi074.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521201] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521201/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521201/ sentry: https://sentry.ceph.com/sentry/sepia/?query=03f19f15be63414a90b2683af1bc4dec {'Failure object was': {'smithi073.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5521221] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521221/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521221/ sentry: https://sentry.ceph.com/sentry/sepia/?query=035f063d03dc462888499621c16817dc {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'Data could not be sent to remote host "smithi121.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi121.front.sepia.ceph.com port 22: No route to host\r\n', 'unreachable': True}} [5521224] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521224/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521224/ sentry: https://sentry.ceph.com/sentry/sepia/?query=273d02c8eadd4fe882b6b9875f1eecf0 SSH connection to smithi073 was lost: 'sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart' [5521233] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521233/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521233/ sentry: https://sentry.ceph.com/sentry/sepia/?query=bc037852868b4420b68cf0dc097b72b5 {'Failure object was': {'smithi121.front.sepia.ceph.com': {'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable', 'invocation': {'module_args': {'name': 'nagios_run_sudo', 'state': True, 'persistent': True, 'ignore_selinux_state': False}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'nagios_run_sudo')"} [5521254] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521254/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521254/ sentry: https://sentry.ceph.com/sentry/sepia/?query=425cdddb155e40d7a2343fe7f1d1f3d2 SSH connection to smithi121 was lost: 'sudo yum install -y kernel' Pass ================================================================= [5520886] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mon} time: 00:38:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520886/ [5520887] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} time: 00:18:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520887/ [5520888] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520888/ [5520889] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 02:06:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520889/ [5520890] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:24 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520890/ [5520891] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520891/ [5520892] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:10:24 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520892/ [5520893] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:41:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520893/ [5520894] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} time: 00:08:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520894/ [5520895] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520895/ [5520896] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:11:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520896/ [5520897] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520897/ [5520898] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:11:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520898/ [5520899] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520899/ [5520900] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520900/ [5520901] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:10:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520901/ [5520902] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520902/ [5520903] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:12:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520903/ [5520904] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520904/ [5520905] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:14:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520905/ [5520906] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520906/ [5520907] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:19:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520907/ [5520908] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:19:53 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520908/ [5520910] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:22:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520910/ [5520911] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:03:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520911/ [5520912] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:25:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520912/ [5520913] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:20:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520913/ [5520914] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520914/ [5520915] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:08:32 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520915/ [5520916] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520916/ [5520917] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520917/ [5520918] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:09:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520918/ [5520919] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:14:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520919/ [5520920] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520920/ [5520921] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520921/ [5520922] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520922/ [5520923] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520923/ [5520924] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520924/ [5520925] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:21:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520925/ [5520926] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520926/ [5520927] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520927/ [5520928] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520928/ [5520929] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:29:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520929/ [5520930] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:16:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520930/ [5520931] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520931/ [5520932] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520932/ [5520933] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:09:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520933/ [5520934] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520934/ [5520935] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:13 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520935/ [5520936] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:26:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520936/ [5520937] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:19:03 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520937/ [5520938] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520938/ [5520939] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520939/ [5520940] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:14:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520940/ [5520941] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:17:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520941/ [5520942] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520942/ [5520943] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:15:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520943/ [5520944] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:01:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520944/ [5520945] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:30:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520945/ [5520946] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:31:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520946/ [5520947] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:04 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520947/ [5520948] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520948/ [5520949] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:06:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520949/ [5520951] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520951/ [5520952] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:27:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520952/ [5520953] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/failover} time: 00:13:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520953/ [5520955] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:34 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520955/ [5520956] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:18:26 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520956/ [5520957] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520957/ [5520958] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520958/ [5520959] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:32:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520959/ [5520960] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:25:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520960/ [5520961] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:14:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520961/ [5520962] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:23:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520962/ [5520963] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520963/ [5520964] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520964/ [5520965] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 00:08:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520965/ [5520966] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520966/ [5520967] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520967/ [5520968] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:47:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520968/ [5520969] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520969/ [5520970] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:19:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520970/ [5520971] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:34 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520971/ [5520972] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:23:52 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520972/ [5520973] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520973/ [5520974] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:23:20 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520974/ [5520975] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 01:06:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520975/ [5520977] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520977/ [5520978] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520978/ [5520979] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:06:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520979/ [5520980] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:27 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520980/ [5520981] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:07:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520981/ [5520982] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:32:10 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520982/ [5520983] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520983/ [5520984] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} time: 00:09:52 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520984/ [5520985] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:39:08 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520985/ [5520986] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520986/ [5520987] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:00:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520987/ [5520988] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:36:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520988/ [5520989] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:13:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520989/ [5520991] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:28:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520991/ [5520992] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:14:24 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520992/ [5520993] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:27 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520993/ [5520994] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520994/ [5520995] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520995/ [5520996] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:11:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520996/ [5520997] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:09:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520997/ [5520998] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520998/ [5520999] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5520999/ [5521000] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:08:04 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521000/ [5521001] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521001/ [5521002] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:18:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521002/ [5521003] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521003/ [5521004] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:09:34 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521004/ [5521005] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:21:52 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521005/ [5521006] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521006/ [5521007] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} time: 00:17:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521007/ [5521008] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:13 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521008/ [5521009] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521009/ [5521010] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:21:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521010/ [5521012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:18:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521012/ [5521013] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:37:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521013/ [5521014] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521014/ [5521015] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:15:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521015/ [5521016] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:12:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521016/ [5521017] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521017/ [5521018] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521018/ [5521020] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:26:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521020/ [5521021] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521021/ [5521022] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:20:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521022/ [5521023] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521023/ [5521024] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521024/ [5521026] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:31:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521026/ [5521028] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521028/ [5521029] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521029/ [5521030] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521030/ [5521031] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:09:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521031/ [5521032] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:23:20 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521032/ [5521033] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:04:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521033/ [5521034] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:26 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521034/ [5521035] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521035/ [5521036] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:18:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521036/ [5521037] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:31:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521037/ [5521038] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521038/ [5521039] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:03 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521039/ [5521040] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:27:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521040/ [5521041] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521041/ [5521042] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521042/ [5521043] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} time: 00:12:11 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521043/ [5521044] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:27:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521044/ [5521045] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:20:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521045/ [5521046] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:09:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521046/ [5521047] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521047/ [5521048] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521048/ [5521049] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:13:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521049/ [5521050] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:22:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521050/ [5521051] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:16:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521051/ [5521052] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:27:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521052/ [5521053] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:24:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521053/ [5521054] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521054/ [5521055] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521055/ [5521057] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521057/ [5521058] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:24:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521058/ [5521059] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:19:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521059/ [5521060] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521060/ [5521061] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:05:10 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521061/ [5521062] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521062/ [5521063] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:15:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521063/ [5521064] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521064/ [5521065] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521065/ [5521066] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521066/ [5521067] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521067/ [5521068] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521068/ [5521069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:25:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521069/ [5521070] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521070/ [5521071] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521071/ [5521072] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:49:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521072/ [5521073] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} time: 00:23:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521073/ [5521074] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:21:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521074/ [5521075] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:22:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521075/ [5521076] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 02:30:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521076/ [5521077] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:22:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521077/ [5521078] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521078/ [5521079] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:05:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521079/ [5521080] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:09 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521080/ [5521082] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521082/ [5521083] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:04:20 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521083/ [5521084] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:14:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521084/ [5521085] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:44:53 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521085/ [5521086] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 02:03:24 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521086/ [5521087] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:03 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521087/ [5521088] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521088/ [5521089] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:16:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521089/ [5521090] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521090/ [5521091] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:06:53 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521091/ [5521092] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:08:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521092/ [5521093] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521093/ [5521095] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:29:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521095/ [5521096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:14:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521096/ [5521097] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521097/ [5521098] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:03 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521098/ [5521099] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:26:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521099/ [5521100] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:35:08 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521100/ [5521101] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521101/ [5521102] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:21:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521102/ [5521103] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:11:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521103/ [5521105] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521105/ [5521107] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:09:32 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521107/ [5521108] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:18:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521108/ [5521109] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:42:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521109/ [5521110] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} time: 00:17:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521110/ [5521111] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521111/ [5521113] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:21:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521113/ [5521114] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521114/ [5521115] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:18:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521115/ [5521116] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:20:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521116/ [5521117] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} time: 00:16:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521117/ [5521118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521118/ [5521119] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521119/ [5521120] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:20:27 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521120/ [5521121] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:12:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521121/ [5521122] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521122/ [5521125] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521125/ [5521126] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 01:19:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521126/ [5521127] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:27:52 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521127/ [5521128] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:40:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521128/ [5521131] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:31 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521131/ [5521134] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521134/ [5521135] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:33:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521135/ [5521136] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521136/ [5521137] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:15:05 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521137/ [5521138] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:20:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521138/ [5521139] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:09:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521139/ [5521140] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:30:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521140/ [5521141] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:50:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521141/ [5521142] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521142/ [5521143] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521143/ [5521144] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521144/ [5521145] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:32:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521145/ [5521146] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521146/ [5521147] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:07:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521147/ [5521148] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:31:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521148/ [5521149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521149/ [5521150] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:42 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521150/ [5521151] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521151/ [5521152] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521152/ [5521153] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:21:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521153/ [5521154] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:20:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521154/ [5521155] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521155/ [5521156] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521156/ [5521157] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:10:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521157/ [5521158] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:19:34 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521158/ [5521159] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521159/ [5521160] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:07:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521160/ [5521161] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521161/ [5521162] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521162/ [5521164] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:23:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521164/ [5521165] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521165/ [5521166] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/workunits} time: 00:07:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521166/ [5521167] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:34:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521167/ [5521168] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521168/ [5521169] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521169/ [5521170] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:56:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521170/ [5521171] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/many workloads/snaps-few-objects} time: 00:37:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521171/ [5521172] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521172/ [5521173] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521173/ [5521175] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:41:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521175/ [5521176] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:31:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521176/ [5521177] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:26:44 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521177/ [5521178] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:07:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521178/ [5521179] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:15:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521179/ [5521180] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521180/ [5521182] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521182/ [5521183] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:12:44 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521183/ [5521184] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:14:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521184/ [5521185] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:11:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521185/ [5521186] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521186/ [5521188] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:41 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521188/ [5521190] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:09:08 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521190/ [5521191] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:11:08 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521191/ [5521192] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521192/ [5521193] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:12:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521193/ [5521194] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521194/ [5521195] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521195/ [5521196] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} time: 00:12:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521196/ [5521197] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:17:21 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521197/ [5521199] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:07:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521199/ [5521200] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:24:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521200/ [5521202] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:32 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521202/ [5521203] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:31:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521203/ [5521204] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521204/ [5521205] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/crush} time: 00:12:28 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521205/ [5521206] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:26:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521206/ [5521207] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521207/ [5521208] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:24:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521208/ [5521210] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:41 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521210/ [5521211] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521211/ [5521212] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521212/ [5521214] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521214/ [5521215] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:15:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521215/ [5521216] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:11 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521216/ [5521217] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:12:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521217/ [5521218] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:20:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521218/ [5521219] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:25 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521219/ [5521220] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521220/ [5521222] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:18:11 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521222/ [5521223] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:56 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521223/ [5521225] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:10 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521225/ [5521226] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:07:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521226/ [5521227] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:29:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521227/ [5521228] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521228/ [5521229] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:04:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521229/ [5521230] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} time: 00:18:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521230/ [5521231] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521231/ [5521232] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:11:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521232/ [5521234] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:47:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521234/ [5521235] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:20:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521235/ [5521236] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:34:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521236/ [5521237] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:39 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521237/ [5521238] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:12:13 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521238/ [5521239] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521239/ [5521241] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:16:41 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521241/ [5521242] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:22:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521242/ [5521243] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521243/ [5521244] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521244/ [5521245] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:23:46 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521245/ [5521246] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521246/ [5521247] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:04:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521247/ [5521248] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:17:33 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521248/ [5521249] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:23:04 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521249/ [5521250] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/failover} time: 00:10:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521250/ [5521251] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521251/ [5521252] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521252/ [5521253] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache} time: 00:12:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521253/ [5521255] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:27 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521255/ [5521256] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521256/ [5521257] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521257/ [5521258] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} time: 00:12:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521258/ [5521259] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:23:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521259/ [5521260] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:00 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521260/ [5521261] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:29:40 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521261/ [5521263] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:13:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521263/ [5521264] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 01:05:16 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521264/ [5521265] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:04:53 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521265/ [5521266] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} time: 00:09:38 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521266/ [5521267] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521267/ [5521268] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:14 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521268/ [5521269] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 02:26:12 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521269/ [5521271] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:16:50 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521271/ [5521272] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:15:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521272/ [5521273] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:26:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521273/ [5521274] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:59 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521274/ [5521275] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:16:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521275/ [5521276] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:18 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521276/ [5521277] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521277/ [5521278] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:12:06 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521278/ [5521279] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:23:23 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521279/ [5521280] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:44 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521280/ [5521281] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:55:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521281/ [5521282] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} time: 00:15:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521282/ [5521283] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:11:35 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521283/ [5521284] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521284/ [5521285] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:20 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521285/ [5521286] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:10 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521286/ [5521287] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:15:52 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521287/ [5521289] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521289/ [5521290] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:20:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521290/ [5521291] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:45:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521291/ [5521293] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/insights} time: 00:13:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521293/ [5521294] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:22:36 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521294/ [5521295] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:13 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521295/ [5521296] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:22:01 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521296/ [5521297] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:19:09 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521297/ [5521298] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:25:44 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521298/ [5521299] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} time: 00:26:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521299/ [5521300] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:30 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521300/ [5521301] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:19:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521301/ [5521302] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:26 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521302/ [5521303] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521303/ [5521305] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521305/ [5521306] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:05:26 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521306/ [5521307] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:31:43 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521307/ [5521308] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:22:02 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521308/ [5521309] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:45 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521309/ [5521310] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:17 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521310/ [5521311] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521311/ [5521312] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:13:07 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521312/ [5521313] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:58 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521313/ [5521314] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:32:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521314/ [5521315] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:22 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521315/ [5521316] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:09:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521316/ [5521317] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:30:55 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521317/ [5521318] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:32:48 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521318/ [5521319] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521319/ [5521320] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:26:57 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521320/ [5521321] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:49 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521321/ [5521322] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:32 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521322/ [5521323] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:25:31 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521323/ [5521324] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:24:54 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521324/ [5521325] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:37 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521325/ [5521326] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:25:47 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521326/ [5521327] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:11:19 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521327/ [5521328] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:15 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521328/ [5521329] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} time: 00:18:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521329/ [5521330] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:29 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521330/ [5521331] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:51 info: http://pulpito.ceph.com/kchai-2020-10-13_01:10:32-rados-wip-kefu-testing-2020-10-12-1615-distro-basic-smithi/5521331/