2020-07-18T16:47:29.923 INFO:root:teuthology version: 1.0.0-0084e27 2020-07-18T16:47:29.925 INFO:teuthology.results:subset: '201/3000' 2020-07-18T16:47:29.927 INFO:teuthology.results:seed: '7979' 2020-07-18T21:04:37.059 INFO:root:teuthology version: 1.0.0-0084e27 2020-07-18T21:04:37.082 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-18T23:59:46.242 INFO:teuthology.results:Tests finished! gathering results... 2020-07-19T00:00:28.796 INFO:scrape:Found 379 jobs 2020-07-19T00:00:33.924 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:33.927 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:33.928 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:33.929 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:33.929 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:33.930 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:33.931 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:33.931 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:33.932 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:33.933 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:33.934 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:33.934 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:33.935 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:33.936 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:33.936 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:33.937 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:33.938 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:33.938 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:33.939 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:33.940 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:33.940 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:34.167 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:34.170 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:34.171 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:34.171 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:34.172 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:34.173 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:34.173 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.174 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.175 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:34.176 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:34.176 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:34.177 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:34.177 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:34.178 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:34.179 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:34.179 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:34.180 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:34.181 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:34.181 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:34.182 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:34.183 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:34.413 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:34.417 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:34.417 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:34.418 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:34.419 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:34.419 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:34.420 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.421 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.422 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:34.422 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:34.423 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:34.424 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:34.424 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:34.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:34.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:34.426 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:34.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:34.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:34.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:34.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:34.431 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:34.628 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:34.631 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:34.632 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:34.632 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:34.633 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:34.634 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:34.635 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.636 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.636 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:34.637 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:34.638 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:34.639 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:34.639 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:34.640 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:34.640 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:34.641 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:34.642 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:34.642 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:34.643 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:34.644 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:34.644 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:34.805 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:34.808 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:34.809 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:34.810 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:34.810 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:34.811 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:34.812 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.813 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:34.816 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:34.817 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:34.818 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:34.819 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:34.820 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:34.820 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:34.821 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:34.821 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:34.822 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:34.823 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:34.823 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:34.824 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:34.825 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:35.015 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:35.020 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:35.021 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:35.022 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:35.022 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:35.023 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:35.024 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:35.026 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:35.027 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:35.027 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:35.028 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:35.029 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:35.029 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:35.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:35.031 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:35.033 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:35.034 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:35.035 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:35.035 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:35.036 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:35.037 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:35.286 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-3494-g5b654577a22 (5b654577a221f83a2b36707a59e12f26359634d8) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fbc30f79d46] , 2: (()+0x275f60) [0x7fbc30f79f60] 2020-07-19T00:00:35.289 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-18T18:59:49.966 INFO:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-18T18:59:50.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2020-07-19T00:00:35.290 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:01:32.385 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-18T19:01:32.475 INFO:tasks.ceph.osd.2:Stopped , 2020-07-18T19:01:32.476 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-07-19T00:00:35.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:42.678 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS , 2020-07-18T19:06:42.679 DEBUG:teuthology.misc:System to be installed: CentOS , 2020-07-18T19:06:42.680 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2020-07-19T00:00:35.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:44.940 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. , 2020-07-18T19:06:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test , 2020-07-18T19:06:44.990 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2020-07-19T00:00:35.292 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:48.279 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 , 2020-07-18T19:06:48.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.0.0-3494.g5b654577a22.el8.x86_64 3/4 2020-07-19T00:00:35.293 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:49.992 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:35.297 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch1.6.8-3.el8 @CentOS-Base 75 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 @CentOS-AppStream 175 k , 2020-07-18T19:06:50.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_642:16.0.0-3494.g5b654577a22.el8 @ceph 1.2 M 2020-07-19T00:00:35.298 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:06:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-execnet-1.7.1-1.el8.noarch 21/85 , 2020-07-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-urllib3-1.24.2-2.el8.noarch 23/85 , 2020-07-18T19:06:56.259 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 2020-07-19T00:00:35.299 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:03.246 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-selinux-2:16.0.0-3494.g5b654577a22.el8.x86_64 68/85 , 2020-07-18T19:07:03.374 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-cephfs-2:16.0.0-3494.g5b654577a22.el8.x86_ 61/85 , 2020-07-18T19:07:03.594 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 62/85 2020-07-19T00:00:35.300 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 29/85 , 2020-07-18T19:07:22.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3494.g5b654577a22.e 30/85 , 2020-07-18T19:07:22.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.0.0-3494.g5b654577a22.el8 31/85 2020-07-19T00:00:35.300 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 , 2020-07-18T19:07:23.389 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 39/85 , 2020-07-18T19:07:23.390 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 40/85 2020-07-19T00:00:35.301 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:23.909 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-07-18T19:07:23.910 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-19T00:00:35.303 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-18T19:07:25.160 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-19T00:00:35.304 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: , 2020-07-18T19:07:27.664 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! , 2020-07-18T19:07:27.733 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3494.g5b654577a 1/1 2020-07-19T00:00:35.304 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:31.715 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 , 2020-07-18T19:07:31.721 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/1 , 2020-07-18T19:07:31.722 INFO:teuthology.orchestra.run.smithi026.stdout: Erasing : ceph-fuse-2:16.0.0-3494.g5b654577a22.el8.x86_64 1/3 2020-07-19T00:00:35.305 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ , 2020-07-18T19:07:34.676 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 3 Packages 2020-07-19T00:00:35.307 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: x86_64 15:2.12.0-88.module_el8.1.0+297+df420408.3 , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: @CentOS-AppStream 34 k , 2020-07-18T19:07:38.386 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:16.0.0-3494.g5b654577a22.el8 @ceph 296 k 2020-07-19T00:00:35.308 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. , 2020-07-18T19:07:42.006 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. , 2020-07-18T19:07:42.007 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2020-07-19T00:00:35.309 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:07:46.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-07-18T19:07:46.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... , 2020-07-18T19:07:46.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2020-07-19T00:00:35.310 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-18T19:08:08.583 INFO:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-07-18T19:08:08.599 INFO:teuthology.orchestra.run.smithi012.stdout: 262184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 18 19:06 /home/ubuntu/cephtest , 2020-07-18T19:08:08.600 INFO:teuthology.orchestra.run.smithi012.stdout: 262189 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 18 19:07 /home/ubuntu/cephtest/archive 2020-07-19T00:00:35.613 INFO:scrape:Found 6 distinct failure reasons 2020-07-19T00:00:35.615 INFO:scrape:Failure: 2020-07-19T00:00:35.616 INFO:scrape:1 jobs: ['5238049'] 2020-07-19T00:00:35.616 INFO:scrape:suites: ['clusters/{fixed-2', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/repair_test}'] 2020-07-19T00:00:35.617 INFO:scrape: 2020-07-19T00:00:35.617 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-19T00:00:35.618 INFO:scrape:3 jobs: ['5238090', '5237793', '5238057'] 2020-07-19T00:00:35.618 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_7.6}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2020-07-19T00:00:35.619 INFO:scrape:suites union: ['1-install/luminous', '1-install/mimic-v1only', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}'] 2020-07-19T00:00:35.619 INFO:scrape: 2020-07-19T00:00:35.620 INFO:scrape:Failure: Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) 2020-07-19T00:00:35.620 INFO:scrape:9 jobs: ['5237999', '5237959', '5238127', '5237914', '5237872', '5238087', '5237833', '5238047', '5237791'] 2020-07-19T00:00:35.621 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}'] 2020-07-19T00:00:35.621 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2020-07-19T00:00:35.622 INFO:scrape: 2020-07-19T00:00:35.622 INFO:scrape:Failure: Command failed on smithi073 with status 2: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5b654577a221f83a2b36707a59e12f26359634d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b3053cf0-c923-11ea-a06f-001a4aab830c -- ceph orch daemon add mon 'smithi073:[v1:172.21.15.73:6789]=c'" 2020-07-19T00:00:35.623 INFO:scrape:1 jobs: ['5237859'] 2020-07-19T00:00:35.624 INFO:scrape:suites: ['1-install/mimic', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{centos_7.6}', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}'] 2020-07-19T00:00:35.625 INFO:scrape: 2020-07-19T00:00:35.625 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-07-19T00:00:35.626 INFO:scrape:1 jobs: ['5237910'] 2020-07-19T00:00:35.626 INFO:scrape:suites: ['msgr-failures/many', 'msgr/async', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2020-07-19T00:00:35.627 INFO:scrape: 2020-07-19T00:00:35.627 INFO:scrape:Failure: Command failed on smithi019 with status 1: 'sudo yum -y install ceph-mgr-diskprediction-local' 2020-07-19T00:00:35.627 INFO:scrape:1 jobs: ['5238009'] 2020-07-19T00:00:35.628 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/lockdep}'] 2020-07-19T00:00:35.628 INFO:scrape: 2020-07-19T00:00:35.653 INFO:teuthology.results:Sending results to dzafman@redhat.com: Test Run: dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/ failed: 16 dead: 0 running: 0 waiting: 0 queued: 0 passed: 363 Fail ================================================================= [5237791] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:23:59 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237791/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237791/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4030f72ffa9344ac98f34f75deb6665a Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5237793] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:24:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237793/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237793/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aa92aea1ea4f42789bf049a3e47718ea reached maximum tries (180) after waiting for 180 seconds [5237833] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:23:53 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237833/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237833/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c984b50686234407b7b0a4a1e887de93 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5237859] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:12:34 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237859/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237859/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0b38efa5852b40b080f632f1e12f3d78 Command failed on smithi073 with status 2: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:5b654577a221f83a2b36707a59e12f26359634d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b3053cf0-c923-11ea-a06f-001a4aab830c -- ceph orch daemon add mon 'smithi073:[v1:172.21.15.73:6789]=c'" [5237872] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:24:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237872/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237872/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d30f9bfb3fe24b778bbbf85eb68c1db4 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5237910] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:18:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237910/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237910/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5237914] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237914/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237914/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=feda2ba7a45e4a9c84f4ca232138e9bb Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5237959] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:24:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237959/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237959/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5e074a4fe25a40069b689d2f00dbb174 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5237999] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:24 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237999/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237999/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8d7c9a068f6a495ebdae6b794b40765f Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5238009] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:03:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238009/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238009/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2a0548fbf29747d7b9170d4112ff83c3 Command failed on smithi019 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5238047] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238047/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238047/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fea7759291984a9b9985341658522930 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5238049] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} ----------------------------------------------------------------- time: 00:10:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238049/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238049/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bc6ac87b1fdf437c99f067dcc39ecc73 [5238057] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:24:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238057/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238057/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3f972bd95ac34386b653c3865f40e5fd reached maximum tries (180) after waiting for 180 seconds [5238087] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:19:35 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238087/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238087/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9c1297dadf6347fbb75a4aa5bd4dc11b Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) [5238090] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:25:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238090/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238090/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a697ae41727449e6bcea0f6d34c18a3c reached maximum tries (180) after waiting for 180 seconds [5238127] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:24:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238127/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238127/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cdf5b23d58774ebc99056a2136dc2866 Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest) Pass ================================================================= [5237781] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:55 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237781/ [5237782] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:11:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237782/ [5237783] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:13:24 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237783/ [5237784] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237784/ [5237785] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:49 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237785/ [5237786] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:13:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237786/ [5237787] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:15:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237787/ [5237788] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} time: 00:22:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237788/ [5237789] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:38 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237789/ [5237790] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:12:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237790/ [5237792] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:30 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237792/ [5237794] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunk-promote-flush} time: 00:12:36 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237794/ [5237795] rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237795/ [5237796] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:08:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237796/ [5237797] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:17:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237797/ [5237798] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:15:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237798/ [5237799] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237799/ [5237800] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:22:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237800/ [5237801] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:19:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237801/ [5237802] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237802/ [5237803] rados/singleton/{all/radostool msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:22:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237803/ [5237804] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:21:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237804/ [5237805] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:36 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237805/ [5237806] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:24:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237806/ [5237807] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} time: 00:07:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237807/ [5237808] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237808/ [5237809] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:42:46 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237809/ [5237810] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:55 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237810/ [5237811] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237811/ [5237812] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237812/ [5237813] rados/singleton/{all/random-eio msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:24:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237813/ [5237814] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237814/ [5237815] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:52 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237815/ [5237816] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237816/ [5237817] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:28 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237817/ [5237818] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:46:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237818/ [5237819] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:12:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237819/ [5237820] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:17:56 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237820/ [5237821] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:23:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237821/ [5237822] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:35 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237822/ [5237823] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:34:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237823/ [5237824] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:19:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237824/ [5237825] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:31:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237825/ [5237826] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:13:52 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237826/ [5237827] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:18:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237827/ [5237828] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:24:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237828/ [5237829] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237829/ [5237830] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237830/ [5237831] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:32:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237831/ [5237832] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:17:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237832/ [5237834] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:47:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237834/ [5237835] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:33:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237835/ [5237836] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:12:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237836/ [5237837] rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:21:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237837/ [5237838] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237838/ [5237839] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237839/ [5237840] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} time: 01:24:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237840/ [5237841] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237841/ [5237842] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:03:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237842/ [5237843] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:22:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237843/ [5237844] rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:07:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237844/ [5237845] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:24:52 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237845/ [5237846] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:21:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237846/ [5237847] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237847/ [5237848] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:19:33 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237848/ [5237849] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:24:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237849/ [5237850] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237850/ [5237851] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237851/ [5237852] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:00 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237852/ [5237853] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237853/ [5237854] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:00 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237854/ [5237855] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:16:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237855/ [5237856] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} time: 00:16:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237856/ [5237857] rados/singleton/{all/test-crash msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237857/ [5237858] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:31:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237858/ [5237860] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup_tier} time: 00:15:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237860/ [5237861] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:03 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237861/ [5237862] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237862/ [5237863] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237863/ [5237864] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:41:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237864/ [5237865] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237865/ [5237866] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:25:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237866/ [5237867] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:14:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237867/ [5237868] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237868/ [5237869] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237869/ [5237870] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:35:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237870/ [5237871] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:17:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237871/ [5237873] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:12:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237873/ [5237874] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:12:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237874/ [5237875] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}} time: 00:18:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237875/ [5237876] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:14:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237876/ [5237877] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} time: 03:45:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237877/ [5237878] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237878/ [5237879] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:25:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237879/ [5237880] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:15:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237880/ [5237881] rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:24:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237881/ [5237882] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237882/ [5237883] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:55 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237883/ [5237884] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} time: 00:32:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237884/ [5237885] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:16:54 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237885/ [5237886] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237886/ [5237887] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:12:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237887/ [5237888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:15:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237888/ [5237889] rados/singleton/{all/thrash-eio msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:42:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237889/ [5237890] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} time: 00:09:35 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237890/ [5237891] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:56 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237891/ [5237892] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:59:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237892/ [5237893] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:08:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237893/ [5237894] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:09:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237894/ [5237895] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237895/ [5237896] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237896/ [5237897] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:24:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237897/ [5237898] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/progress} time: 00:17:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237898/ [5237899] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:15:17 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237899/ [5237900] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04} fixed-2} time: 00:16:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237900/ [5237901] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} time: 00:13:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237901/ [5237902] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:22:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237902/ [5237903] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237903/ [5237904] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237904/ [5237905] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:25:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237905/ [5237906] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:07:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237906/ [5237907] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:20:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237907/ [5237908] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:25:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237908/ [5237909] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237909/ [5237911] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:42 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237911/ [5237912] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237912/ [5237913] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:18:17 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237913/ [5237915] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} time: 00:22:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237915/ [5237916] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:11:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237916/ [5237917] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:28:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237917/ [5237918] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:33:55 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237918/ [5237919] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:38 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237919/ [5237920] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237920/ [5237921] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_latest}} time: 00:07:52 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237921/ [5237922] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:35 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237922/ [5237923] rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237923/ [5237924] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237924/ [5237925] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237925/ [5237926] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:30:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237926/ [5237927] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:22:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237927/ [5237928] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237928/ [5237929] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:38 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237929/ [5237930] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:27:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237930/ [5237931] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:24 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237931/ [5237932] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:36 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237932/ [5237933] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237933/ [5237934] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:20:49 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237934/ [5237935] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:14:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237935/ [5237936] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:35:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237936/ [5237937] rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:11:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237937/ [5237938] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:19:07 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237938/ [5237939] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:32:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237939/ [5237940] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:17:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237940/ [5237941] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:03:46 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237941/ [5237942] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:27:49 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237942/ [5237943] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:34 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237943/ [5237944] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} time: 00:07:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237944/ [5237945] rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:07:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237945/ [5237946] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:21:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237946/ [5237947] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:15:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237947/ [5237948] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:22:28 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237948/ [5237949] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237949/ [5237950] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237950/ [5237951] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:09:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237951/ [5237952] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:11:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237952/ [5237953] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:46 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237953/ [5237954] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:19:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237954/ [5237955] rados/singleton/{all/divergent_priors msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:13:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237955/ [5237956] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup_tier} time: 00:16:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237956/ [5237957] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:41:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237957/ [5237958] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:23:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237958/ [5237960] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:06:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237960/ [5237961] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237961/ [5237962] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237962/ [5237963] rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:13:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237963/ [5237964] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237964/ [5237965] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:23:28 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237965/ [5237966] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} time: 00:10:52 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237966/ [5237967] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/workunits} time: 00:07:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237967/ [5237968] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237968/ [5237969] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237969/ [5237970] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237970/ [5237971] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:43:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237971/ [5237972] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:41:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237972/ [5237973] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237973/ [5237974] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237974/ [5237975] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:33:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237975/ [5237976] rados/singleton/{all/dump-stuck msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:13:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237976/ [5237977] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:11:00 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237977/ [5237978] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:13:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237978/ [5237979] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:16:53 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237979/ [5237980] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:36 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237980/ [5237981] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} time: 00:21:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237981/ [5237982] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:10:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237982/ [5237983] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:15:34 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237983/ [5237984] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237984/ [5237985] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:35:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237985/ [5237986] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects} time: 00:19:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237986/ [5237987] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237987/ [5237988] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} time: 00:27:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237988/ [5237989] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237989/ [5237990] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237990/ [5237991] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:09:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237991/ [5237992] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:21:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237992/ [5237993] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:17:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237993/ [5237994] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237994/ [5237995] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:33:29 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237995/ [5237996] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:06:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237996/ [5237997] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:25:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237997/ [5237998] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5237998/ [5238000] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} time: 00:09:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238000/ [5238001] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:27:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238001/ [5238002] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238002/ [5238003] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:35:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238003/ [5238004] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238004/ [5238005] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:21:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238005/ [5238006] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:27:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238006/ [5238007] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238007/ [5238008] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:10 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238008/ [5238010] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:13:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238010/ [5238011] rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:32:34 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238011/ [5238012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:22:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238012/ [5238013] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} time: 00:12:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238013/ [5238014] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238014/ [5238015] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} time: 00:30:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238015/ [5238016] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:29:33 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238016/ [5238017] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:11:17 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238017/ [5238018] rados/singleton/{all/lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:29:56 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238018/ [5238019] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:34 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238019/ [5238020] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:21 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238020/ [5238021] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238021/ [5238022] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:46:07 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238022/ [5238023] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238023/ [5238024] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:17 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238024/ [5238025] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238025/ [5238026] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238026/ [5238027] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:28:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238027/ [5238028] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238028/ [5238029] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:23:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238029/ [5238030] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238030/ [5238031] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:11:00 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238031/ [5238032] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:03:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238032/ [5238033] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:08:42 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238033/ [5238034] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238034/ [5238035] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} time: 00:25:24 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238035/ [5238036] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/failover} time: 00:16:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238036/ [5238037] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:24:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238037/ [5238038] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:32:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238038/ [5238039] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238039/ [5238040] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:20 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238040/ [5238041] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238041/ [5238042] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:48 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238042/ [5238043] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:25:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238043/ [5238044] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:55 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238044/ [5238045] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:24:03 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238045/ [5238046] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238046/ [5238048] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:39:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238048/ [5238050] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:21:05 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238050/ [5238051] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238051/ [5238052] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:15:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238052/ [5238053] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:11:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238053/ [5238054] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} time: 00:07:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238054/ [5238055] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup_tier} time: 00:09:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238055/ [5238056] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:15:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238056/ [5238058] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} time: 00:26:42 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238058/ [5238059] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238059/ [5238060] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238060/ [5238061] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238061/ [5238062] rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:56 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238062/ [5238063] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} time: 00:34:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238063/ [5238064] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:27:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238064/ [5238065] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:13:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238065/ [5238066] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:39:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238066/ [5238067] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238067/ [5238068] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:25:30 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238068/ [5238069] rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238069/ [5238070] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:12:07 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238070/ [5238071] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:12:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238071/ [5238072] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/insights} time: 00:16:38 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238072/ [5238073] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:31:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238073/ [5238074] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}} time: 00:13:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238074/ [5238075] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:49 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238075/ [5238076] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:18 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238076/ [5238077] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:29 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238077/ [5238078] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238078/ [5238079] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238079/ [5238080] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:21:28 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238080/ [5238081] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238081/ [5238082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:13:04 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238082/ [5238083] rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:17:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238083/ [5238084] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:30 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238084/ [5238085] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238085/ [5238086] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_8.0} fixed-2} time: 00:19:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238086/ [5238088] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:06:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238088/ [5238089] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238089/ [5238091] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:18:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238091/ [5238092] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:07:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238092/ [5238093] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:43:17 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238093/ [5238094] rados/singleton/{all/mon-config msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:12:40 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238094/ [5238095] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:32:21 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238095/ [5238096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:24:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238096/ [5238097] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238097/ [5238098] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238098/ [5238099] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:26:36 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238099/ [5238100] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} time: 00:22:25 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238100/ [5238101] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} time: 00:08:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238101/ [5238102] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:23:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238102/ [5238103] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:39 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238103/ [5238104] rados/singleton/{all/osd-backfill msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:19:21 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238104/ [5238105] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:17:59 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238105/ [5238106] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238106/ [5238107] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:23:29 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238107/ [5238108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238108/ [5238109] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238109/ [5238110] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:26:38 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238110/ [5238111] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:31:07 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238111/ [5238112] rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:18:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238112/ [5238113] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:46 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238113/ [5238114] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:02 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238114/ [5238115] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:14 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238115/ [5238116] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:23 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238116/ [5238117] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:04:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238117/ [5238118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238118/ [5238119] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:14:53 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238119/ [5238120] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} time: 00:17:22 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238120/ [5238121] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:38:15 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238121/ [5238122] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_api_tests} time: 00:33:43 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238122/ [5238123] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:17:51 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238123/ [5238124] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:12:46 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238124/ [5238125] rados/singleton/{all/osd-recovery msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:45 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238125/ [5238126] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:03:37 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238126/ [5238128] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:32:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238128/ [5238129] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:17:19 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238129/ [5238130] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:16:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238130/ [5238131] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:31 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238131/ [5238132] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:33 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238132/ [5238133] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:16:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238133/ [5238134] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238134/ [5238135] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 01:51:32 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238135/ [5238136] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:41 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238136/ [5238137] rados/singleton/{all/peer msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:07:26 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238137/ [5238138] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:23:53 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238138/ [5238139] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:17:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238139/ [5238140] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:27:54 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238140/ [5238141] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:11 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238141/ [5238142] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:21:42 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238142/ [5238143] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:13 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238143/ [5238144] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:24:01 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238144/ [5238145] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:10:05 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238145/ [5238146] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:13:08 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238146/ [5238147] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 02:58:05 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238147/ [5238148] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} time: 00:20:56 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238148/ [5238149] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:09:47 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238149/ [5238150] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup_tier} time: 00:09:57 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238150/ [5238151] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:58 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238151/ [5238152] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:07 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238152/ [5238153] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:16 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238153/ [5238154] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:33 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238154/ [5238155] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:10:50 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238155/ [5238156] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:22:06 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238156/ [5238157] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:27 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238157/ [5238158] rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238158/ [5238159] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:14:09 info: http://pulpito.ceph.com/dzafman-2020-07-18_09:43:13-rados-wip-zafman-testing-distro-basic-smithi/5238159/