2020-07-19T02:15:56.631 INFO:root:teuthology version: 1.0.0-0084e27 2020-07-19T02:15:56.633 INFO:teuthology.results:subset: '2/9999' 2020-07-19T02:15:56.634 INFO:teuthology.results:seed: '7537' 2020-07-19T04:07:56.801 INFO:root:teuthology version: 1.0.0-0084e27 2020-07-19T04:07:56.830 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-19T08:56:09.196 INFO:teuthology.results:Tests finished! gathering results... 2020-07-19T08:56:38.499 INFO:scrape:Found 308 jobs 2020-07-19T08:56:38.835 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3452-gf88211b (f88211b6ac8bbe5876e5c74d82bd82f88fda1ac4) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fb781bfd6f7] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x555dad5e9a60] 2020-07-19T08:56:38.839 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-19T04:11:15.454 INFO:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-19T04:11:15.842 INFO:teuthology.orchestra.run.smithi159.stdout: 2020-07-19T08:56:38.840 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:38.840 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:38.841 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:20:58.279 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-19T08:56:38.842 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:01.159 INFO:teuthology.orchestra.run.smithi159.stdout:Removing files ... , 2020-07-19T04:21:01.164 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... , (Reading database ... 5% 2020-07-19T08:56:38.843 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:38.844 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-19T08:56:38.845 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 20% , (Reading database ... 25% , (Reading database ... 30% 2020-07-19T08:56:38.846 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:14.141 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... , 2020-07-19T04:21:14.440 INFO:teuthology.orchestra.run.smithi159.stdout:Removing ceph-base (16.0.0-3452-gf88211b-1bionic) ... , 2020-07-19T04:21:14.476 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 2020-07-19T08:56:38.847 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 30% , (Reading database ... 35% , (Reading database ... 40% 2020-07-19T08:56:38.848 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: , 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core jq libjq1 libleveldb1v5 liboath0 libonig4 , 2020-07-19T04:21:23.790 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-07-19T08:56:38.849 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 10% , (Reading database ... 15% , (Reading database ... 20% 2020-07-19T08:56:38.851 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet , 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. , 2020-07-19T04:21:27.518 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-19T08:56:38.852 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 100% , (Reading database ... 107645 files and directories currently installed.) , 2020-07-19T04:21:28.473 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-rbd (16.0.0-3452-gf88211b-1bionic) ... 2020-07-19T08:56:38.853 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2020-07-19T08:56:38.854 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:38.855 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-19T08:56:38.856 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 25% , (Reading database ... 30% , (Reading database ... 35% 2020-07-19T08:56:38.857 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:40.923 INFO:teuthology.orchestra.run.smithi087.stdout: libopus0 liborc-0.4-0 librabbitmq4 libraw1394-11 librdkafka1 libsamplerate0 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libshout3 libsnappy1v5 libspeex1 libspice-server1 libtag1v5 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libtag1v5-vanilla libtwolame0 libusbredirparser1 libv4l-0 libv4lconvert0 2020-07-19T08:56:38.858 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 80% , (Reading database ... 85% , (Reading database ... 90% 2020-07-19T08:56:38.859 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libleveldb1v5 liblttng-ust0 libmp3lame0 libmpg123-0 liboath0 libonig4 2020-07-19T08:56:38.860 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:52.248 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libfdt1:amd64 (1.4.5-3) ... , 2020-07-19T04:21:52.410 INFO:teuthology.orchestra.run.smithi087.stdout:Removing libmp3lame0:amd64 (3.100-2) ... , 2020-07-19T04:21:52.619 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libspice-server1:amd64 (0.14.0-1ubuntu2.4) ... 2020-07-19T08:56:38.861 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:13.841 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-dateutil (2.6.1-1) ... , 2020-07-19T04:22:13.942 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-bcrypt (3.1.4-2) ... , 2020-07-19T04:22:14.325 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-sklearn (0.19.1-3) ... 2020-07-19T08:56:38.863 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:38.920 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-webob (1:1.7.3-2fakesync1) ... , 2020-07-19T04:22:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-websocket (0.44.0-0ubuntu2) ... , 2020-07-19T04:22:39.778 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-19T08:56:38.864 WARNING:scrape:Ignoring malparsed backtrace: running.get() , File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2020-07-19T08:56:39.086 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3452-gf88211b (f88211b6ac8bbe5876e5c74d82bd82f88fda1ac4) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fb781bfd6f7] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x555dad5e9a60] 2020-07-19T08:56:39.091 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-19T04:11:15.454 INFO:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-19T04:11:15.842 INFO:teuthology.orchestra.run.smithi159.stdout: 2020-07-19T08:56:39.092 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.093 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.102 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:20:58.279 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-19T08:56:39.102 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:01.159 INFO:teuthology.orchestra.run.smithi159.stdout:Removing files ... , 2020-07-19T04:21:01.164 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... , (Reading database ... 5% 2020-07-19T08:56:39.103 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.104 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-19T08:56:39.104 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 20% , (Reading database ... 25% , (Reading database ... 30% 2020-07-19T08:56:39.105 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:14.141 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... , 2020-07-19T04:21:14.440 INFO:teuthology.orchestra.run.smithi159.stdout:Removing ceph-base (16.0.0-3452-gf88211b-1bionic) ... , 2020-07-19T04:21:14.476 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 2020-07-19T08:56:39.105 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 30% , (Reading database ... 35% , (Reading database ... 40% 2020-07-19T08:56:39.106 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: , 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core jq libjq1 libleveldb1v5 liboath0 libonig4 , 2020-07-19T04:21:23.790 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-07-19T08:56:39.108 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 10% , (Reading database ... 15% , (Reading database ... 20% 2020-07-19T08:56:39.108 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet , 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. , 2020-07-19T04:21:27.518 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-19T08:56:39.109 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 100% , (Reading database ... 107645 files and directories currently installed.) , 2020-07-19T04:21:28.473 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-rbd (16.0.0-3452-gf88211b-1bionic) ... 2020-07-19T08:56:39.110 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2020-07-19T08:56:39.110 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.111 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-19T08:56:39.112 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 25% , (Reading database ... 30% , (Reading database ... 35% 2020-07-19T08:56:39.112 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:40.923 INFO:teuthology.orchestra.run.smithi087.stdout: libopus0 liborc-0.4-0 librabbitmq4 libraw1394-11 librdkafka1 libsamplerate0 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libshout3 libsnappy1v5 libspeex1 libspice-server1 libtag1v5 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libtag1v5-vanilla libtwolame0 libusbredirparser1 libv4l-0 libv4lconvert0 2020-07-19T08:56:39.113 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 80% , (Reading database ... 85% , (Reading database ... 90% 2020-07-19T08:56:39.114 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libleveldb1v5 liblttng-ust0 libmp3lame0 libmpg123-0 liboath0 libonig4 2020-07-19T08:56:39.115 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:52.248 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libfdt1:amd64 (1.4.5-3) ... , 2020-07-19T04:21:52.410 INFO:teuthology.orchestra.run.smithi087.stdout:Removing libmp3lame0:amd64 (3.100-2) ... , 2020-07-19T04:21:52.619 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libspice-server1:amd64 (0.14.0-1ubuntu2.4) ... 2020-07-19T08:56:39.115 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:13.841 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-dateutil (2.6.1-1) ... , 2020-07-19T04:22:13.942 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-bcrypt (3.1.4-2) ... , 2020-07-19T04:22:14.325 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-sklearn (0.19.1-3) ... 2020-07-19T08:56:39.116 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:38.920 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-webob (1:1.7.3-2fakesync1) ... , 2020-07-19T04:22:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-websocket (0.44.0-0ubuntu2) ... , 2020-07-19T04:22:39.778 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-19T08:56:39.117 WARNING:scrape:Ignoring malparsed backtrace: running.get() , File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2020-07-19T08:56:39.322 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3452-gf88211b (f88211b6ac8bbe5876e5c74d82bd82f88fda1ac4) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fb781bfd6f7] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x555dad5e9a60] 2020-07-19T08:56:39.326 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-19T04:11:15.454 INFO:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-19T04:11:15.842 INFO:teuthology.orchestra.run.smithi159.stdout: 2020-07-19T08:56:39.327 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.328 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.329 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:20:58.279 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-19T08:56:39.330 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:01.159 INFO:teuthology.orchestra.run.smithi159.stdout:Removing files ... , 2020-07-19T04:21:01.164 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... , (Reading database ... 5% 2020-07-19T08:56:39.330 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.331 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-19T08:56:39.332 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 20% , (Reading database ... 25% , (Reading database ... 30% 2020-07-19T08:56:39.333 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:14.141 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... , 2020-07-19T04:21:14.440 INFO:teuthology.orchestra.run.smithi159.stdout:Removing ceph-base (16.0.0-3452-gf88211b-1bionic) ... , 2020-07-19T04:21:14.476 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 2020-07-19T08:56:39.333 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 30% , (Reading database ... 35% , (Reading database ... 40% 2020-07-19T08:56:39.334 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: , 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core jq libjq1 libleveldb1v5 liboath0 libonig4 , 2020-07-19T04:21:23.790 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-07-19T08:56:39.335 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 10% , (Reading database ... 15% , (Reading database ... 20% 2020-07-19T08:56:39.335 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet , 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. , 2020-07-19T04:21:27.518 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-19T08:56:39.336 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 100% , (Reading database ... 107645 files and directories currently installed.) , 2020-07-19T04:21:28.473 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-rbd (16.0.0-3452-gf88211b-1bionic) ... 2020-07-19T08:56:39.337 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2020-07-19T08:56:39.338 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.338 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-19T08:56:39.339 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 25% , (Reading database ... 30% , (Reading database ... 35% 2020-07-19T08:56:39.340 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:40.923 INFO:teuthology.orchestra.run.smithi087.stdout: libopus0 liborc-0.4-0 librabbitmq4 libraw1394-11 librdkafka1 libsamplerate0 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libshout3 libsnappy1v5 libspeex1 libspice-server1 libtag1v5 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libtag1v5-vanilla libtwolame0 libusbredirparser1 libv4l-0 libv4lconvert0 2020-07-19T08:56:39.341 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 80% , (Reading database ... 85% , (Reading database ... 90% 2020-07-19T08:56:39.341 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libleveldb1v5 liblttng-ust0 libmp3lame0 libmpg123-0 liboath0 libonig4 2020-07-19T08:56:39.342 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:52.248 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libfdt1:amd64 (1.4.5-3) ... , 2020-07-19T04:21:52.410 INFO:teuthology.orchestra.run.smithi087.stdout:Removing libmp3lame0:amd64 (3.100-2) ... , 2020-07-19T04:21:52.619 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libspice-server1:amd64 (0.14.0-1ubuntu2.4) ... 2020-07-19T08:56:39.345 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:13.841 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-dateutil (2.6.1-1) ... , 2020-07-19T04:22:13.942 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-bcrypt (3.1.4-2) ... , 2020-07-19T04:22:14.325 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-sklearn (0.19.1-3) ... 2020-07-19T08:56:39.346 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:38.920 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-webob (1:1.7.3-2fakesync1) ... , 2020-07-19T04:22:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-websocket (0.44.0-0ubuntu2) ... , 2020-07-19T04:22:39.778 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-19T08:56:39.347 WARNING:scrape:Ignoring malparsed backtrace: running.get() , File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2020-07-19T08:56:39.568 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3452-gf88211b (f88211b6ac8bbe5876e5c74d82bd82f88fda1ac4) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fb781bfd6f7] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x555dad5e9a60] 2020-07-19T08:56:39.572 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-19T04:11:15.454 INFO:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-19T04:11:15.842 INFO:teuthology.orchestra.run.smithi159.stdout: 2020-07-19T08:56:39.573 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.574 WARNING:scrape:Ignoring malparsed backtrace: raise value.with_traceback(tb) , File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run , File "/home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks/rados.py", line 266, in thread 2020-07-19T08:56:39.574 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:20:58.279 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-19T08:56:39.575 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:01.159 INFO:teuthology.orchestra.run.smithi159.stdout:Removing files ... , 2020-07-19T04:21:01.164 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... , (Reading database ... 5% 2020-07-19T08:56:39.576 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-19T04:21:07.045 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-19T08:56:39.577 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 20% , (Reading database ... 25% , (Reading database ... 30% 2020-07-19T08:56:39.577 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:14.141 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... , 2020-07-19T04:21:14.440 INFO:teuthology.orchestra.run.smithi159.stdout:Removing ceph-base (16.0.0-3452-gf88211b-1bionic) ... , 2020-07-19T04:21:14.476 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 2020-07-19T08:56:39.578 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 30% , (Reading database ... 35% , (Reading database ... 40% 2020-07-19T08:56:39.579 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: , 2020-07-19T04:21:23.789 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core jq libjq1 libleveldb1v5 liboath0 libonig4 , 2020-07-19T04:21:23.790 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-07-19T08:56:39.579 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 10% , (Reading database ... 15% , (Reading database ... 20% 2020-07-19T08:56:39.580 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet , 2020-07-19T04:21:27.485 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. , 2020-07-19T04:21:27.518 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-07-19T08:56:39.581 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 100% , (Reading database ... 107645 files and directories currently installed.) , 2020-07-19T04:21:28.473 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-rbd (16.0.0-3452-gf88211b-1bionic) ... 2020-07-19T08:56:39.581 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob , 2020-07-19T04:21:31.049 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2020-07-19T08:56:39.582 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-19T08:56:39.583 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-19T08:56:39.583 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 25% , (Reading database ... 30% , (Reading database ... 35% 2020-07-19T08:56:39.584 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:40.923 INFO:teuthology.orchestra.run.smithi087.stdout: libopus0 liborc-0.4-0 librabbitmq4 libraw1394-11 librdkafka1 libsamplerate0 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libshout3 libsnappy1v5 libspeex1 libspice-server1 libtag1v5 , 2020-07-19T04:21:40.924 INFO:teuthology.orchestra.run.smithi087.stdout: libtag1v5-vanilla libtwolame0 libusbredirparser1 libv4l-0 libv4lconvert0 2020-07-19T08:56:39.585 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 80% , (Reading database ... 85% , (Reading database ... 90% 2020-07-19T08:56:39.585 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1 , 2020-07-19T04:21:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: libleveldb1v5 liblttng-ust0 libmp3lame0 libmpg123-0 liboath0 libonig4 2020-07-19T08:56:39.586 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:21:52.248 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libfdt1:amd64 (1.4.5-3) ... , 2020-07-19T04:21:52.410 INFO:teuthology.orchestra.run.smithi087.stdout:Removing libmp3lame0:amd64 (3.100-2) ... , 2020-07-19T04:21:52.619 INFO:teuthology.orchestra.run.smithi159.stdout:Removing libspice-server1:amd64 (0.14.0-1ubuntu2.4) ... 2020-07-19T08:56:39.586 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:13.841 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-dateutil (2.6.1-1) ... , 2020-07-19T04:22:13.942 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-bcrypt (3.1.4-2) ... , 2020-07-19T04:22:14.325 INFO:teuthology.orchestra.run.smithi087.stdout:Removing python3-sklearn (0.19.1-3) ... 2020-07-19T08:56:39.587 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-19T04:22:38.920 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-webob (1:1.7.3-2fakesync1) ... , 2020-07-19T04:22:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-websocket (0.44.0-0ubuntu2) ... , 2020-07-19T04:22:39.778 INFO:teuthology.orchestra.run.smithi159.stdout:Removing python3-werkzeug (0.14.1+dfsg1-1) ... 2020-07-19T08:56:39.588 WARNING:scrape:Ignoring malparsed backtrace: running.get() , File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get , File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2020-07-19T08:56:41.860 INFO:scrape:Found 5 distinct failure reasons 2020-07-19T08:56:41.863 INFO:scrape:Failure: Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) 2020-07-19T08:56:41.863 INFO:scrape:8 jobs: ['5228540', '5228573', '5228611', '5228681', '5228506', '5228647', '5228474', '5228439'] 2020-07-19T08:56:41.864 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}'] 2020-07-19T08:56:41.865 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/dashboard}'] 2020-07-19T08:56:41.865 INFO:scrape: 2020-07-19T08:56:41.866 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-07-19T08:56:41.867 INFO:scrape:1 jobs: ['5228656'] 2020-07-19T08:56:41.868 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}'] 2020-07-19T08:56:41.870 INFO:scrape: 2020-07-19T08:56:41.870 INFO:scrape:Failure: {'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi106.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2020-07-19T08:56:41.871 INFO:scrape:6 jobs: ['5228452', '5228442', '5228433', '5228404', '5228426', '5228407'] 2020-07-19T08:56:41.871 INFO:scrape:suites intersection: [] 2020-07-19T08:56:41.872 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'd-balancer/on', 'debug/mgr', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/lost-unfound-delete', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/dashboard}', 'thrashers/fastread', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/redirect}'] 2020-07-19T08:56:41.873 INFO:scrape: 2020-07-19T08:56:41.873 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-19T08:56:41.874 INFO:scrape:3 jobs: ['5228503', '5228533', '5228401'] 2020-07-19T08:56:41.874 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_7.6}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2020-07-19T08:56:41.875 INFO:scrape:suites union: ['1-install/mimic', '1-install/nautilus', '1-install/octopus', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/default', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2020-07-19T08:56:41.875 INFO:scrape: 2020-07-19T08:56:41.876 INFO:scrape:Failure: {'smithi106.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2020-07-19T08:56:41.876 INFO:scrape:1 jobs: ['5228436'] 2020-07-19T08:56:41.876 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-comp-zstd', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_8}', 'tasks/failover}'] 2020-07-19T08:56:41.877 INFO:scrape: 2020-07-19T08:56:41.894 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/ failed: 12 dead: 7 running: 0 waiting: 0 queued: 0 passed: 289 Fail ================================================================= [5228401] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228401/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228401/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c0379cc30d894090b4046e0ddead3dd2 reached maximum tries (180) after waiting for 180 seconds [5228439] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228439/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ac44b48eedc34e24afa00be1a25b36f2 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228474] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228474/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228474/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5ead7251cf9422db8244395ba439fc1 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228503] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228503/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228503/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=69c5d29286a44e52b73ee84972212720 reached maximum tries (180) after waiting for 180 seconds [5228506] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228506/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=18e43a0e141c480a8b387c4bb00b379b Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228533] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228533/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228533/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=de8606bdbab6497ba099d860aa478b5a reached maximum tries (180) after waiting for 180 seconds [5228540] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228540/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228540/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b518f4b9e07a47acbb5e8b909a3e1201 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228573] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228573/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228573/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8275f0b4a5e5423aa2f0257f6a426ee1 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228611] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228611/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228611/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2a969dc3ea6f420ebbe776c4069df752 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228647] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228647/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228647/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f69edd6e850c4b518377a9cacb858af0 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5228656] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:25:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228656/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228656/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5228681] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:23:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228681/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228681/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=26e4c92df3af4bbeb974cf214187ba77 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) Dead ================================================================= [5228404] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228404/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228404/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5a8052e956f14093a407012632b8a81f {'smithi103.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi058.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228407] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:04:48 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228407/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228407/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e1296d7ad6524e60b83ceeadb7608c71 {'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228426] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228426/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228426/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a103d982e87746608a015ecab76721f6 {'smithi069.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228433] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228433/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228433/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2f37f4b7c55b4a1581a053f4b2e9651b {'smithi101.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228436] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/failover} ----------------------------------------------------------------- time: 00:05:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228436/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228436/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fc09fb07bd4b41a0a303565c10376e66 {'smithi106.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228442] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228442/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8c687e40d9fc404b8a4c48966b2faf10 {'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [5228452] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228452/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228452/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c58b704ae798440e9540bf3fac7f6b46 {'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi106.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [5228393] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228393/ [5228394] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228394/ [5228395] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228395/ [5228396] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228396/ [5228397] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228397/ [5228398] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} time: 00:29:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228398/ [5228399] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup_tier} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228399/ [5228400] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228400/ [5228402] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228402/ [5228403] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:40:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228403/ [5228405] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228405/ [5228406] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228406/ [5228408] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228408/ [5228409] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} time: 03:45:54 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228409/ [5228410] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228410/ [5228411] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228411/ [5228412] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228412/ [5228413] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228413/ [5228414] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228414/ [5228415] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228415/ [5228416] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228416/ [5228417] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228417/ [5228418] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228418/ [5228419] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228419/ [5228420] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:25:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228420/ [5228421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 02:08:58 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228421/ [5228422] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{centos_8}} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228422/ [5228423] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228423/ [5228424] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228424/ [5228425] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228425/ [5228427] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:55:20 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228427/ [5228428] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228428/ [5228429] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228429/ [5228430] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228430/ [5228431] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228431/ [5228432] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} time: 00:38:25 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228432/ [5228434] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:34:36 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228434/ [5228435] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:51:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228435/ [5228437] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228437/ [5228438] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:35:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228438/ [5228440] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228440/ [5228441] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228441/ [5228443] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228443/ [5228444] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:52:19 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228444/ [5228445] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228445/ [5228446] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228446/ [5228447] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228447/ [5228448] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228448/ [5228449] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:45:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228449/ [5228450] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228450/ [5228451] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} time: 00:26:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228451/ [5228453] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228453/ [5228454] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228454/ [5228455] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:21 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228455/ [5228456] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228456/ [5228457] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228457/ [5228458] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228458/ [5228459] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228459/ [5228460] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_8}} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228460/ [5228461] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228461/ [5228462] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228462/ [5228463] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/insights} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228463/ [5228464] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:53:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228464/ [5228465] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228465/ [5228466] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228466/ [5228467] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228467/ [5228468] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:41:28 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228468/ [5228469] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async start tasks/rados_api_tests} time: 00:34:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228469/ [5228470] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:34:17 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228470/ [5228471] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:38:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228471/ [5228472] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228472/ [5228473] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228473/ [5228475] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228475/ [5228476] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228476/ [5228477] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228477/ [5228478] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228478/ [5228479] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228479/ [5228480] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228480/ [5228481] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228481/ [5228482] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228482/ [5228483] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228483/ [5228484] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228484/ [5228485] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228485/ [5228486] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228486/ [5228487] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228487/ [5228488] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228488/ [5228489] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228489/ [5228490] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228490/ [5228491] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228491/ [5228492] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228492/ [5228493] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228493/ [5228494] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} time: 00:32:20 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228494/ [5228495] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228495/ [5228496] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228496/ [5228497] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228497/ [5228498] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228498/ [5228499] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228499/ [5228500] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228500/ [5228501] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228501/ [5228502] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228502/ [5228504] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228504/ [5228505] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228505/ [5228507] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:17:42 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228507/ [5228508] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228508/ [5228509] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} time: 00:40:47 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228509/ [5228510] rados/singleton/{all/mon-config msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228510/ [5228511] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228511/ [5228512] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228512/ [5228513] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228513/ [5228514] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228514/ [5228515] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:36 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228515/ [5228516] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228516/ [5228517] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:04 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228517/ [5228518] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228518/ [5228519] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228519/ [5228520] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228520/ [5228521] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228521/ [5228522] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228522/ [5228523] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228523/ [5228524] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:35:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228524/ [5228525] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228525/ [5228526] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228526/ [5228527] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228527/ [5228528] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228528/ [5228529] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228529/ [5228530] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_python} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228530/ [5228531] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228531/ [5228532] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} time: 00:18:21 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228532/ [5228534] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228534/ [5228535] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228535/ [5228536] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 00:32:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228536/ [5228537] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228537/ [5228538] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228538/ [5228539] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:43:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228539/ [5228541] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:26:05 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228541/ [5228542] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228542/ [5228543] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228543/ [5228544] rados/singleton/{all/peer msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228544/ [5228545] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228545/ [5228546] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228546/ [5228547] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228547/ [5228548] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 02:13:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228548/ [5228549] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} time: 00:38:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228549/ [5228550] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228550/ [5228551] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228551/ [5228552] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228552/ [5228553] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228553/ [5228554] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228554/ [5228555] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228555/ [5228556] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228556/ [5228557] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228557/ [5228558] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228558/ [5228559] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228559/ [5228560] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} time: 00:35:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228560/ [5228561] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:34:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228561/ [5228562] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228562/ [5228563] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228563/ [5228564] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228564/ [5228565] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:21:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228565/ [5228566] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228566/ [5228567] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228567/ [5228568] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228568/ [5228569] rados/singleton/{all/radostool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228569/ [5228570] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228570/ [5228571] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228571/ [5228572] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228572/ [5228574] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228574/ [5228575] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228575/ [5228576] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228576/ [5228577] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228577/ [5228578] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_latest} fixed-2} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228578/ [5228579] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:47 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228579/ [5228580] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228580/ [5228581] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228581/ [5228582] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 00:57:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228582/ [5228583] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:29:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228583/ [5228584] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228584/ [5228585] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228585/ [5228586] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_8}} time: 00:17:58 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228586/ [5228587] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228587/ [5228588] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228588/ [5228589] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228589/ [5228590] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228590/ [5228591] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:21:24 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228591/ [5228592] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228592/ [5228593] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228593/ [5228594] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228594/ [5228595] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228595/ [5228596] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228596/ [5228597] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:34:35 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228597/ [5228598] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228598/ [5228599] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228599/ [5228600] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228600/ [5228601] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_latest}} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228601/ [5228602] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228602/ [5228603] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228603/ [5228604] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228604/ [5228605] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228605/ [5228606] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:27:07 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228606/ [5228607] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/crash} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228607/ [5228608] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228608/ [5228609] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:38:04 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228609/ [5228610] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228610/ [5228612] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228612/ [5228613] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228613/ [5228614] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} time: 01:25:26 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228614/ [5228615] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228615/ [5228616] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async start tasks/rados_api_tests} time: 00:41:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228616/ [5228617] rados/singleton/{all/test-crash msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228617/ [5228618] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228618/ [5228619] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:34:45 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228619/ [5228620] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228620/ [5228621] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{ubuntu_latest}} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228621/ [5228622] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228622/ [5228623] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:22:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228623/ [5228624] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228624/ [5228625] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228625/ [5228626] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:12:53 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228626/ [5228627] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228627/ [5228628] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:36 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228628/ [5228629] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:39:57 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228629/ [5228630] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:08:26 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228630/ [5228631] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} time: 00:29:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228631/ [5228632] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228632/ [5228633] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228633/ [5228634] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228634/ [5228635] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228635/ [5228636] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228636/ [5228637] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228637/ [5228638] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} time: 00:21:54 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228638/ [5228639] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228639/ [5228640] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:38:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228640/ [5228641] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228641/ [5228642] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228642/ [5228643] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228643/ [5228644] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228644/ [5228645] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228645/ [5228646] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228646/ [5228648] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228648/ [5228649] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:48:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228649/ [5228650] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228650/ [5228651] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:24:09 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228651/ [5228652] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228652/ [5228653] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} time: 00:36:50 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228653/ [5228654] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228654/ [5228655] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228655/ [5228657] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228657/ [5228658] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228658/ [5228659] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228659/ [5228660] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228660/ [5228661] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup_tier} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228661/ [5228662] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228662/ [5228663] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228663/ [5228664] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228664/ [5228665] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228665/ [5228666] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 01:20:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228666/ [5228667] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228667/ [5228668] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} time: 02:12:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228668/ [5228669] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:01 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228669/ [5228670] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228670/ [5228671] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async start tasks/rados_python} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228671/ [5228672] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228672/ [5228673] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228673/ [5228674] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228674/ [5228675] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228675/ [5228676] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:35:04 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228676/ [5228677] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_8}} time: 00:27:07 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228677/ [5228678] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228678/ [5228679] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} time: 00:32:42 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228679/ [5228680] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:38:00 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228680/ [5228682] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:39:03 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228682/ [5228683] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228683/ [5228684] rados/singleton/{all/deduptool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228684/ [5228685] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:32:15 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228685/ [5228686] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228686/ [5228687] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228687/ [5228688] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async start tasks/rados_api_tests} time: 00:36:17 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228688/ [5228689] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228689/ [5228690] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228690/ [5228691] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228691/ [5228692] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:39:10 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228692/ [5228693] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228693/ [5228694] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228694/ [5228695] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:37:31 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228695/ [5228696] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228696/ [5228697] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228697/ [5228698] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228698/ [5228699] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228699/ [5228700] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:44 info: http://pulpito.ceph.com/teuthology-2020-07-15_07:01:02-rados-master-distro-basic-smithi/5228700/