2020-07-03T01:47:51.043 INFO:root:teuthology version: 1.0.0-5208279 2020-07-03T01:47:51.044 INFO:teuthology.results:subset: '834/9999' 2020-07-03T01:47:51.045 INFO:teuthology.results:seed: '2477' 2020-07-03T03:26:39.622 INFO:root:teuthology version: 1.0.0-5208279 2020-07-03T03:26:39.643 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-03T15:27:04.126 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2020-07-03T15:27:24.699 INFO:scrape:Found 308 jobs 2020-07-03T15:27:27.897 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:27.900 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:27.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:27.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:27.902 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:27.902 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:27.903 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:27.904 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:27.904 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:27.905 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:27.905 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:27.906 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:27.907 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:27.907 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:27.908 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:27.908 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:27.909 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:27.910 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:27.910 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:27.911 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:27.911 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:27.912 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:27.913 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:27.913 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:27.914 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:27.914 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.047 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.049 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.051 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.053 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.053 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.054 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.055 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.055 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.056 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.056 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.059 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.059 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.060 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.062 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.062 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.063 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.064 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.194 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.197 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.197 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.198 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.199 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.199 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.201 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.202 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.202 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.203 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.203 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.205 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.207 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.210 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.211 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.211 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.340 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.343 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.344 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.344 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.345 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.346 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.346 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.347 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.347 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.348 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.349 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.349 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.350 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.350 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.351 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.352 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.352 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.353 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.353 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.354 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.355 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.355 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.356 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.356 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.357 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.358 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.496 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.499 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.499 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.500 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.501 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.501 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.502 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.503 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.503 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.504 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.504 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.505 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.506 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.506 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.507 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.508 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.508 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.509 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.509 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.510 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.511 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.511 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.512 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.513 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.513 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.514 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.651 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.654 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.654 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.655 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.656 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.656 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.657 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.657 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.658 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.659 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.659 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.660 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.660 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.661 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.662 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.662 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.663 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.663 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.664 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.665 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.665 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.666 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.667 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.667 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.668 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.668 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:28.805 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3138-g5fbbbaa (5fbbbaa1143e921c2d75a43288975f5a755d72b8) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7fdd3e62b1e7] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x501) [0x5654dbf4ec61] 2020-07-03T15:27:28.808 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T02:13:50.713 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T02:13:50.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2020-07-03T15:27:28.809 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:15:13.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit , 2020-07-03T02:15:13.015 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T02:15:13.059 INFO:tasks.ceph.mgr.x:Stopped 2020-07-03T15:27:28.809 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: , 2020-07-03T02:16:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon ceph-osd , 2020-07-03T02:16:29.995 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2020-07-03T15:27:28.810 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 5% , (Reading database ... 10% , (Reading database ... 15% 2020-07-03T15:27:28.811 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 1 to remove and 13 not upgraded. , 2020-07-03T02:16:35.377 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 6,708 kB disk space will be freed. , 2020-07-03T02:16:35.497 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 2020-07-03T15:27:28.811 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:38.171 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:16:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2020-07-03T15:27:28.812 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:39.935 INFO:teuthology.orchestra.run.smithi114.stdout:dpkg: warning: while removing ceph-mgr-dashboard, directory '/usr/share/ceph/mgr/dashboard/controllers' not empty so not removed , 2020-07-03T02:16:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:Removing ceph-mgr-diskprediction-cloud (16.0.0-3138-g5fbbbaa-1bionic) ... , 2020-07-03T02:16:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:Removing ceph-mgr-dashboard (16.0.0-3138-g5fbbbaa-1bionic) ... 2020-07-03T15:27:28.812 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 65% , (Reading database ... 70% , (Reading database ... 75% 2020-07-03T15:27:28.813 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 15% , (Reading database ... 20% , (Reading database ... 25% 2020-07-03T15:27:28.814 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-paste python3-pastedeploy python3-pastescript , 2020-07-03T02:16:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py , 2020-07-03T02:16:55.210 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-07-03T15:27:28.814 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:16:57.019 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-07-03T15:27:28.815 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.815 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cycler python3-dateutil , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:00.664 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-07-03T15:27:28.816 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest , 2020-07-03T02:17:02.384 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-07-03T15:27:28.817 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:03.950 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... , (Reading database ... 5% , (Reading database ... 10% 2020-07-03T15:27:28.817 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:05.781 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. , W: --force-yes is deprecated, use one of the options starting with --allow instead. , 2020-07-03T02:17:05.800 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... 2020-07-03T15:27:28.818 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 , 2020-07-03T02:17:07.717 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch , 2020-07-03T02:17:07.718 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-07-03T15:27:28.819 WARNING:scrape:Ignoring malparsed backtrace: (Reading database ... 55% , (Reading database ... 60% , (Reading database ... 65% 2020-07-03T15:27:28.819 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes , 2020-07-03T02:17:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-07-03T15:27:28.820 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:16.182 INFO:teuthology.orchestra.run.smithi114.stdout:Removing cpu-checker (0.7-0ubuntu7) ... , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:Package 'librbd1' is not installed, so not removed , 2020-07-03T02:17:16.380 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2020-07-03T15:27:28.820 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch , 2020-07-03T02:17:17.581 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-07-03T15:27:28.821 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:31.592 INFO:teuthology.orchestra.run.smithi002.stdout:Removing librdkafka1:amd64 (0.11.3-1build1) ... , 2020-07-03T02:17:31.820 INFO:teuthology.orchestra.run.smithi114.stdout:Removing libusbredirparser1:amd64 (0.7.1-1) ... , 2020-07-03T02:17:32.004 INFO:teuthology.orchestra.run.smithi002.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ... 2020-07-03T15:27:28.822 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:17:55.162 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-joblib (0.11-1) ... , 2020-07-03T02:17:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:Removing python3-numpy (1:1.13.3-2ubuntu1) ... , 2020-07-03T02:17:55.658 INFO:teuthology.orchestra.run.smithi002.stdout:Removing python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-07-03T15:27:28.822 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T02:18:16.021 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,023 kB] , 2020-07-03T02:18:16.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] , 2020-07-03T02:18:16.086 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,090 kB] 2020-07-03T15:27:28.823 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 248, in sh , proc = self.run(**kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run 2020-07-03T15:27:34.994 INFO:scrape:Found 8 distinct failure reasons 2020-07-03T15:27:34.995 INFO:scrape:Failure: Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) 2020-07-03T15:27:34.996 INFO:scrape:9 jobs: ['5196537', '5196321', '5196288', '5196432', '5196499', '5196388', '5196466', '5196254', '5196354'] 2020-07-03T15:27:34.996 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}'] 2020-07-03T15:27:34.997 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2020-07-03T15:27:34.997 INFO:scrape: 2020-07-03T15:27:34.998 INFO:scrape:Dead: b'2020-07-03T13:49:13.218 DEBUG:teuthology.exit:Finished running handlers' 2020-07-03T15:27:34.998 INFO:scrape:3 jobs: ['5196285', '5196435', '5196343'] 2020-07-03T15:27:34.998 INFO:scrape:suites intersection: [] 2020-07-03T15:27:34.999 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'd-balancer/crush-compat', 'fast/fast', 'fixed-2', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/cephadm/smoke/{distro/centos_latest', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{more-async-partial-recovery}', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/careful', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-small-objects-many-deletes}', 'workloads/radosbench}'] 2020-07-03T15:27:34.999 INFO:scrape: 2020-07-03T15:27:35.000 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-03T15:27:35.000 INFO:scrape:3 jobs: ['5196291', '5196460', '5196491'] 2020-07-03T15:27:35.001 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_7.6}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2020-07-03T15:27:35.001 INFO:scrape:suites union: ['1-install/luminous', '1-install/mimic-v1only', '1-install/nautilus-v1only', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'msgr-failures/few', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/test_rbd_api}'] 2020-07-03T15:27:35.001 INFO:scrape: 2020-07-03T15:27:35.002 INFO:scrape:Failure: "2020-07-03T03:01:17.444289+0000 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi162:x (4775), after 302.374 seconds" in cluster log 2020-07-03T15:27:35.002 INFO:scrape:1 jobs: ['5196393'] 2020-07-03T15:27:35.003 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2020-07-03T15:27:35.003 INFO:scrape: 2020-07-03T15:27:35.004 INFO:scrape:Failure: Command failed on smithi120 with status 125: 'sudo docker kill -s 1 ceph-edd02552-bcdf-11ea-a06e-001a4aab830c-osd.7' 2020-07-03T15:27:35.004 INFO:scrape:1 jobs: ['5196523'] 2020-07-03T15:27:35.004 INFO:scrape:suites: ['1-install/mimic', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{centos_7.6}', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}'] 2020-07-03T15:27:35.005 INFO:scrape: 2020-07-03T15:27:35.005 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-07-03T15:27:35.006 INFO:scrape:1 jobs: ['5196292'] 2020-07-03T15:27:35.006 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}'] 2020-07-03T15:27:35.006 INFO:scrape: 2020-07-03T15:27:35.007 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-07-03T15:27:35.007 INFO:scrape:2 jobs: ['5196274', '5196300'] 2020-07-03T15:27:35.008 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados'] 2020-07-03T15:27:35.008 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'd-balancer/on', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/radosbench-high-concurrency}'] 2020-07-03T15:27:35.009 INFO:scrape: 2020-07-03T15:27:35.009 INFO:scrape:Failure: Command failed on smithi200 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' 2020-07-03T15:27:35.009 INFO:scrape:1 jobs: ['5196355'] 2020-07-03T15:27:35.010 INFO:scrape:suites: ['rados/objectstore/{backends/objectstore', 'supported-random-distro$/{rhel_8}}'] 2020-07-03T15:27:35.010 INFO:scrape: 2020-07-03T15:27:35.023 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/ failed: 18 dead: 3 running: 0 waiting: 0 queued: 1 passed: 287 Fail ================================================================= [5196254] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:24:16 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196254/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196254/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b1f7efac0b5242a2824f9bd2a5b6bc23 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196274] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:57:06 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196274/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196274/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d4954caf38c54c9fb17e0825eea097ce Scrubbing terminated -- not all pgs were active and clean. [5196288] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:29:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196288/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196288/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6567ba6d8a6e4dd3be9655c1d4af2338 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196291] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:25:52 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196291/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196291/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d7563cab2aaa40d2858c7a8836014942 reached maximum tries (180) after waiting for 180 seconds [5196292] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:18:22 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196292/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196292/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5196300] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:49:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196300/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196300/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d6bdfd4aad4c43b794c5f0ec29f2cd44 Scrubbing terminated -- not all pgs were active and clean. [5196321] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:25:10 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196321/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196321/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fae614608f5d47999a265c31cc03f217 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196354] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:21:29 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196354/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196354/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3ce8fdde3d4a49b29f4e223e97fab2c1 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196355] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 04:38:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196355/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196355/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3efc9908bf8a42d39daac0f22874b238 Command failed on smithi200 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to- stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug- filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' [5196388] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:21:13 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196388/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196388/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c86cdbee0f424892b3a11a65d8a00c07 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196393] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 03:30:57 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196393/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196393/ "2020-07-03T03:01:17.444289+0000 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi162:x (4775), after 302.374 seconds" in cluster log [5196432] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:21:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196432/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196432/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a732ccf1128a4fcd800250c64f3c1bea Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196460] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:24:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196460/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196460/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d8e70e183fcd45328bbfb7d20557c498 reached maximum tries (180) after waiting for 180 seconds [5196466] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:25:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196466/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196466/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0dfae292f0864a898031196144fb5cf3 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196491] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:29:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196491/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196491/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=74f00fd462da4e25bb9fb227222ca168 reached maximum tries (180) after waiting for 180 seconds [5196499] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:25:23 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196499/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196499/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e3e5ff1bcc85441e8c31e3d55f1e10a1 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [5196523] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 01:25:17 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196523/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196523/ Command failed on smithi120 with status 125: 'sudo docker kill -s 1 ceph- edd02552-bcdf-11ea-a06e-001a4aab830c-osd.7' [5196537] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:25:01 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196537/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196537/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ce3e6bae8f26439cab781cff0e63f5c4 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) Dead ================================================================= [5196285] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196285/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196285/ [5196343] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196343/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196343/ [5196435] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196435/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196435/ Queued ================================================================= [5196250] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196250/ Pass ================================================================= [5196227] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:26:46 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196227/ [5196228] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:56 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196228/ [5196229] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:58 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196229/ [5196230] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} time: 00:12:42 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196230/ [5196231] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:16 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196231/ [5196232] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:15:30 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196232/ [5196233] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:18:30 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196233/ [5196234] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} time: 00:18:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196234/ [5196235] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} time: 00:26:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196235/ [5196236] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:29 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196236/ [5196237] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196237/ [5196238] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:14:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196238/ [5196239] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:17:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196239/ [5196240] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:12:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196240/ [5196241] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup_tier} time: 00:16:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196241/ [5196242] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:57 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196242/ [5196243] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196243/ [5196244] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}} time: 00:13:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196244/ [5196245] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196245/ [5196246] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:20:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196246/ [5196247] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:01 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196247/ [5196248] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196248/ [5196249] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196249/ [5196250] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:16:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196250/ [5196251] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:21:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196251/ [5196252] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:47:06 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196252/ [5196253] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_latest} fixed-2} time: 00:20:58 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196253/ [5196255] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:12:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196255/ [5196256] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:02 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196256/ [5196257] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:14:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196257/ [5196258] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:15:45 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196258/ [5196259] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:54:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196259/ [5196260] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:17:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196260/ [5196261] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:10:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196261/ [5196262] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:52:20 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196262/ [5196263] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_api_tests} time: 00:36:56 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196263/ [5196264] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_latest}} time: 00:10:07 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196264/ [5196265] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:30:18 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196265/ [5196266] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:24:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196266/ [5196267] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:44 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196267/ [5196268] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:23:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196268/ [5196269] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:41:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196269/ [5196270] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:12:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196270/ [5196271] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:16:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196271/ [5196272] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:51 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196272/ [5196273] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196273/ [5196275] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196275/ [5196276] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:15:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196276/ [5196277] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196277/ [5196278] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/valgrind} time: 00:50:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196278/ [5196279] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:24:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196279/ [5196280] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:33:52 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196280/ [5196281] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_latest}} time: 00:20:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196281/ [5196282] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} time: 00:26:04 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196282/ [5196283] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} time: 00:28:16 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196283/ [5196284] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/workunits} time: 00:15:56 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196284/ [5196286] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:46 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196286/ [5196287] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:05:20 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196287/ [5196289] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:16:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196289/ [5196290] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:27:21 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196290/ [5196293] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:40 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196293/ [5196294] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:16:04 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196294/ [5196295] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196295/ [5196296] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196296/ [5196297] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:20:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196297/ [5196298] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:39 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196298/ [5196299] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196299/ [5196301] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:23:20 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196301/ [5196302] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:44 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196302/ [5196303] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:06:02 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196303/ [5196304] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:22:56 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196304/ [5196305] rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:08:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196305/ [5196306] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196306/ [5196307] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:20:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196307/ [5196308] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:51 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196308/ [5196309] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196309/ [5196310] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:04 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196310/ [5196311] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/lockdep} time: 00:16:53 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196311/ [5196312] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:29 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196312/ [5196313] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196313/ [5196314] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:27:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196314/ [5196315] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/crash} time: 00:10:29 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196315/ [5196316] rados/singleton/{all/deduptool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:12:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196316/ [5196317] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:50 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196317/ [5196318] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:17:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196318/ [5196319] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{ubuntu_latest}} time: 00:21:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196319/ [5196320] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:34:03 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196320/ [5196322] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:22:51 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196322/ [5196323] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:29:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196323/ [5196324] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:50 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196324/ [5196325] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:18:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196325/ [5196326] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:12:49 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196326/ [5196327] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196327/ [5196328] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:09:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196328/ [5196329] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196329/ [5196330] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:59 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196330/ [5196331] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196331/ [5196332] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:51 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196332/ [5196333] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:11 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196333/ [5196334] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} time: 00:08:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196334/ [5196335] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196335/ [5196336] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:14:44 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196336/ [5196337] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:06 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196337/ [5196338] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:19:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196338/ [5196339] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:37 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196339/ [5196340] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} time: 00:27:22 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196340/ [5196341] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:17 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196341/ [5196342] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:25:38 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196342/ [5196344] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} time: 00:12:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196344/ [5196345] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} time: 00:19:10 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196345/ [5196346] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 01:17:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196346/ [5196347] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:13:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196347/ [5196348] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:17:54 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196348/ [5196349] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:20:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196349/ [5196350] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:31:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196350/ [5196351] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196351/ [5196352] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:37:01 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196352/ [5196353] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:31:46 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196353/ [5196356] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:53 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196356/ [5196357] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:42 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196357/ [5196358] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196358/ [5196359] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196359/ [5196360] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196360/ [5196361] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:33:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196361/ [5196362] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:32:50 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196362/ [5196363] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:29:40 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196363/ [5196364] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:04:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196364/ [5196365] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:34:34 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196365/ [5196366] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:21:23 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196366/ [5196367] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:11:07 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196367/ [5196368] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:42 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196368/ [5196369] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196369/ [5196370] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} time: 00:21:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196370/ [5196371] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/insights} time: 00:12:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196371/ [5196372] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196372/ [5196373] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196373/ [5196374] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196374/ [5196375] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196375/ [5196376] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:12:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196376/ [5196377] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:18:10 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196377/ [5196378] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196378/ [5196379] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:33:06 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196379/ [5196380] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:22 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196380/ [5196381] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:15:34 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196381/ [5196382] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:11:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196382/ [5196383] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:22:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196383/ [5196384] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:23:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196384/ [5196385] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:44 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196385/ [5196386] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:50 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196386/ [5196387] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:12:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196387/ [5196389] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:12:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196389/ [5196390] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:09:03 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196390/ [5196391] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} time: 00:15:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196391/ [5196392] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196392/ [5196394] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:29 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196394/ [5196395] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:11:54 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196395/ [5196396] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:22:59 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196396/ [5196397] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:15:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196397/ [5196398] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:52 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196398/ [5196399] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:08:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196399/ [5196400] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:37 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196400/ [5196401] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:58 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196401/ [5196402] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196402/ [5196403] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:29:37 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196403/ [5196404] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196404/ [5196405] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} time: 02:10:44 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196405/ [5196406] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196406/ [5196407] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196407/ [5196408] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:26:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196408/ [5196409] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:21 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196409/ [5196410] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} time: 00:14:49 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196410/ [5196411] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} time: 00:12:40 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196411/ [5196412] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:08:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196412/ [5196413] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:12:43 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196413/ [5196414] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:37 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196414/ [5196415] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196415/ [5196416] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196416/ [5196417] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:32:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196417/ [5196419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:10 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196419/ [5196422] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:43:04 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196422/ [5196425] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:10:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196425/ [5196428] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:19:06 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196428/ [5196430] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196430/ [5196431] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:27:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196431/ [5196433] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:12:40 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196433/ [5196434] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:31:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196434/ [5196436] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_latest}} time: 00:08:19 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196436/ [5196437] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:13 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196437/ [5196438] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/progress} time: 00:19:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196438/ [5196439] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196439/ [5196440] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:53 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196440/ [5196441] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196441/ [5196442] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:17:18 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196442/ [5196443] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:29:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196443/ [5196444] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196444/ [5196445] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:16:49 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196445/ [5196446] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:37:07 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196446/ [5196447] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:47:39 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196447/ [5196448] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:21:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196448/ [5196449] rados/singleton/{all/mon-config msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:12:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196449/ [5196450] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:39:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196450/ [5196451] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:04:37 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196451/ [5196452] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:12:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196452/ [5196453] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:01 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196453/ [5196454] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196454/ [5196455] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:54 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196455/ [5196456] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:20:16 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196456/ [5196457] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:33 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196457/ [5196458] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:24:18 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196458/ [5196459] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:46 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196459/ [5196461] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:18:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196461/ [5196462] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:30 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196462/ [5196463] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:43 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196463/ [5196464] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:29:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196464/ [5196465] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:21 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196465/ [5196467] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:02 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196467/ [5196468] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:11:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196468/ [5196469] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:53 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196469/ [5196470] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:11 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196470/ [5196471] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_latest}} time: 00:06:55 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196471/ [5196472] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:40 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196472/ [5196473] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:28:00 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196473/ [5196474] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:17:08 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196474/ [5196475] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:37:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196475/ [5196476] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:21 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196476/ [5196477] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:26:13 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196477/ [5196478] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:25:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196478/ [5196479] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196479/ [5196480] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:36 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196480/ [5196481] rados/singleton/{all/peer msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:11:52 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196481/ [5196482] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:53 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196482/ [5196483] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:25:02 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196483/ [5196484] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:29:48 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196484/ [5196485] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:27:11 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196485/ [5196486] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:10:43 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196486/ [5196487] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:10 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196487/ [5196488] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:09:27 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196488/ [5196489] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:57 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196489/ [5196490] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:07:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196490/ [5196492] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:39 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196492/ [5196493] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:32:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196493/ [5196494] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:04 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196494/ [5196495] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:08:12 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196495/ [5196496] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:08:02 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196496/ [5196497] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:18 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196497/ [5196498] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196498/ [5196500] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:33:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196500/ [5196501] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:22:16 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196501/ [5196502] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:21 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196502/ [5196503] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:20:52 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196503/ [5196504] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:21:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196504/ [5196505] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:33:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196505/ [5196506] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} time: 00:31:45 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196506/ [5196507] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:16:51 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196507/ [5196508] rados/singleton/{all/radostool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:13:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196508/ [5196509] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} time: 00:12:09 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196509/ [5196510] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:13:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196510/ [5196511] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:46 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196511/ [5196512] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:30:18 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196512/ [5196513] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:49 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196513/ [5196514] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:32 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196514/ [5196515] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:16:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196515/ [5196516] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196516/ [5196517] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:25:13 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196517/ [5196518] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup_tier} time: 00:14:22 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196518/ [5196519] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:55 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196519/ [5196520] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196520/ [5196521] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:23:31 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196521/ [5196522] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:14:30 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196522/ [5196524] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:09:26 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196524/ [5196525] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196525/ [5196526] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/crash} time: 00:14:20 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196526/ [5196527] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:04:24 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196527/ [5196528] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:25 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196528/ [5196529] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 00:28:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196529/ [5196530] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:14 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196530/ [5196531] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:03 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196531/ [5196532] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 02:07:15 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196532/ [5196533] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:19:41 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196533/ [5196534] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:14:03 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196534/ [5196535] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:05 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196535/ [5196536] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:15:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196536/ [5196538] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:09:47 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196538/ [5196539] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} time: 00:23:20 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196539/ [5196540] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:23:28 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196540/ [5196541] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:30 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196541/ [5196542] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:35 info: http://pulpito.ceph.com/kchai-2020-07-03_01:47:32-rados-wip-kefu-testing-2020-07-01-2343-distro-basic-smithi/5196542/