2020-08-23T01:12:53.659 INFO:root:teuthology version: 1.0.0-c0ecc52 2020-08-23T01:12:53.660 INFO:teuthology.results:subset: '8/9999' 2020-08-23T01:12:53.660 INFO:teuthology.results:seed: '435' 2020-08-23T03:05:37.703 INFO:root:teuthology version: 1.0.0-c0ecc52 2020-08-23T03:05:38.805 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-23T09:12:49.868 INFO:teuthology.results:Tests finished! gathering results... 2020-08-23T09:14:49.359 INFO:scrape:Found 151 jobs 2020-08-23T09:14:53.893 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:53.936 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:53.937 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.939 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.940 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.949 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.952 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.959 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:53.960 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:53.961 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:53.961 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:53.962 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:53.963 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:53.963 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:53.964 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:53.965 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:53.965 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:53.966 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:53.967 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:53.968 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:53.969 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:53.969 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:53.970 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:53.971 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:53.971 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:53.972 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:53.972 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:53.973 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:53.974 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:53.974 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:53.975 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:53.976 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:53.976 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:53.977 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:53.978 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.025 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:54.029 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:54.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.032 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.033 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.036 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.038 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.045 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.046 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:54.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:54.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:54.048 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:54.049 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:54.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:54.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:54.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:54.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:54.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:54.053 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:54.053 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:54.054 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:54.055 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.055 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:54.056 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:54.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:54.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:54.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:54.059 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:54.060 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:54.060 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:54.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:54.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:54.062 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:54.063 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.103 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:54.106 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:54.107 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.110 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.111 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.114 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.116 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.123 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.124 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:54.125 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:54.126 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:54.126 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:54.127 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:54.128 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:54.129 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:54.130 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:54.130 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:54.131 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:54.132 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:54.132 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:54.133 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:54.134 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.134 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:54.135 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.136 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:54.136 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:54.137 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:54.137 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:54.138 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:54.139 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:54.139 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:54.140 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:54.140 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:54.141 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:54.142 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.180 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:54.184 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:54.185 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.187 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.188 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.191 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.193 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.207 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:54.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:54.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:54.210 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:54.211 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:54.211 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:54.212 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:54.213 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:54.213 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:54.214 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:54.215 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:54.216 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:54.216 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:54.217 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.218 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:54.218 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.219 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:54.220 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:54.220 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:54.221 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:54.222 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:54.223 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:54.223 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:54.224 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:54.224 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:54.225 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:54.226 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.263 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:54.267 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:54.268 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.270 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.271 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.274 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.284 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.285 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:54.286 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:54.286 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:54.287 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:54.288 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:54.288 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:54.289 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:54.290 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:54.290 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:54.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:54.292 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:54.292 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:54.293 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:54.294 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.294 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:54.295 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.296 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:54.296 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:54.297 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:54.297 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:54.298 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:54.299 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:54.299 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:54.300 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:54.301 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:54.301 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:54.302 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.339 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-4440-ge833956918 (e833956918923b3362942c561ac10e99c384455d) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f2ec3239176] , 2: (()+0x276390) [0x7f2ec3239390] 2020-08-23T09:14:54.343 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:28.378 INFO:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout:{ , 2020-08-23T03:20:28.520 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-08-23T09:14:54.344 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:31.985 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.346 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:32.033 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:32.034 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.347 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.427 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.428 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-08-23T03:19:51.069396+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=51, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.350 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:20:52.484 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2020-08-23T03:19:29.082217+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-08-23T03:19:37.128892+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:20:52.485 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.353 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2020-08-23T03:19:41.066192+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=41, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:12.879 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.360 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T03:19:46.067875+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=19, tm_sec=46, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T03:21:33.258 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2020-08-23T03:20:00.102046+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=3, tm_min=20, tm_sec=26, tm_wday=6, tm_yday=236, tm_isdst=0) 2020-08-23T09:14:54.360 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:34.908 INFO:tasks.ceph.osd.4:Stopped , 2020-08-23T03:22:34.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit , 2020-08-23T03:22:34.909 INFO:teuthology.orchestra.run:waiting for 300 2020-08-23T09:14:54.361 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:50.932 INFO:teuthology.orchestra.run.smithi027:> sudo lsb_release -is , 2020-08-23T03:22:51.014 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS , 2020-08-23T03:22:51.015 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-23T09:14:54.362 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout:Removed: , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.0.0-4440.ge833956918.el8.x86_64 , 2020-08-23T03:22:52.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2020-08-23T09:14:54.363 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:54.775 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: xmlstarlet-1.6.1-11.el8.x86_64 5/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.0.0-4440.ge833956918.el8.x86_64 1/5 , 2020-08-23T03:22:54.776 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2020-08-23T09:14:54.364 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:56.127 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:16.0.0-4440.ge833956918.el8.x86_64 2/4 , 2020-08-23T03:22:56.146 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 , 2020-08-23T03:22:56.147 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : ceph-mon-2:16.0.0-4440.ge833956918.el8.x86_64 3/4 2020-08-23T09:14:54.364 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:16.0.0-4440.ge833956918.el8 @ceph 659 k , 2020-08-23T03:22:57.912 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2020-08-23T09:14:54.365 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_642:16.0.0-4440.ge833956918.el8 @ceph 113 k , 2020-08-23T03:22:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_642:16.0.0-4440.ge833956918.el8 @ceph 265 k 2020-08-23T09:14:54.366 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:22:58.545 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k , 2020-08-23T03:22:58.546 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2020-08-23T09:14:54.366 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-kubernetes-11.0.0-2.el8.noarch 6/85 , 2020-08-23T03:23:00.724 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/85 , 2020-08-23T03:23:00.725 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : ceph-mgr-dashboard-2:16.0.0-4440.ge833956918.el8.n 5/85 2020-08-23T09:14:54.367 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:05.981 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 36/85 , 2020-08-23T03:23:05.985 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-pysocks-1.6.8-3.el8.noarch 39/85 , 2020-08-23T03:23:06.102 INFO:teuthology.orchestra.run.smithi105.stdout: Erasing : python3-apipkg-1.5-6.el8.noarch 40/85 2020-08-23T09:14:54.368 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-argparse-2:16.0.0-4440.ge833956918.el 65/85 , 2020-08-23T03:23:11.045 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 54/85 , 2020-08-23T03:23:11.113 INFO:teuthology.orchestra.run.smithi016.stdout: Erasing : python3-ceph-common-2:16.0.0-4440.ge833956918.el8. 66/85 2020-08-23T09:14:54.369 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:28.889 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:16.0.0-4440.ge833956918.el8.x86_64 11/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 12/85 , 2020-08-23T03:23:28.890 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.22-1.el8.x86_64 13/85 2020-08-23T09:14:54.370 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-4440.ge833956918. 3/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:16.0.0-4440.ge833956918.el8.x86_64 4/85 , 2020-08-23T03:23:30.188 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-4440.ge833956918.el8.noa 5/85 2020-08-23T09:14:54.371 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 , 2020-08-23T03:23:30.337 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.372 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:31.768 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 80/85 , 2020-08-23T03:23:31.933 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : leveldb-1.22-1.el8.x86_64 81/85 , 2020-08-23T03:23:31.934 INFO:teuthology.orchestra.run.smithi027.stdout: Erasing : libradosstriper1-2:16.0.0-4440.ge833956918.el8.x86 82/85 2020-08-23T09:14:54.372 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:32.545 INFO:teuthology.orchestra.run.smithi105.stdout: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout:Removed: , 2020-08-23T03:23:32.546 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:16.0.0-4440.ge833956918.el8.x86_64 2020-08-23T09:14:54.373 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 76/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 77/85 , 2020-08-23T03:23:33.000 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 78/85 2020-08-23T09:14:54.374 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 , 2020-08-23T03:23:34.665 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-08-23T09:14:54.374 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:36.569 INFO:teuthology.orchestra.run.smithi105.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T03:23:36.574 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-08-23T09:14:54.375 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout:Removing unused dependencies: , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:16.0.0-4440.ge833956918.el8 @ceph 1.7 M , 2020-08-23T03:23:38.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-23T09:14:54.376 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:41.238 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. , 2020-08-23T03:23:41.239 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. , 2020-08-23T03:23:41.240 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2020-08-23T09:14:54.376 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:16.0.0-4440.ge833956918.el8.x86_64 3/3 , 2020-08-23T03:23:42.606 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:42.607 INFO:teuthology.orchestra.run.smithi016.stdout:Removed: 2020-08-23T09:14:54.377 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Remove 7 Packages , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: , 2020-08-23T03:23:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:Freed space: 28 M 2020-08-23T09:14:54.378 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size , 2020-08-23T03:23:47.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ , 2020-08-23T03:23:47.561 INFO:teuthology.orchestra.run.smithi027.stdout:Removing: 2020-08-23T09:14:54.378 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:50.616 INFO:teuthology.orchestra.run.smithi027.stdout:No match for argument: librbd1 , No packages marked for removal. , 2020-08-23T03:23:50.621 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2020-08-23T09:14:54.379 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 2 6 377 8 -733us[ -695us] +/- 47ms , 2020-08-23T03:23:55.686 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 71 -234us[ -203us] +/- 61ms , 2020-08-23T03:23:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 8 +2523us[+2562us] +/- 40ms 2020-08-23T09:14:54.380 WARNING:scrape:Ignoring malparsed backtrace: 2020-08-23T03:24:28.400 INFO:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.404 INFO:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest , 2020-08-23T03:24:28.407 INFO:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2020-08-23T09:14:54.701 INFO:scrape:Found 5 distinct failure reasons 2020-08-23T09:14:54.703 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2020-08-23T09:14:54.703 INFO:scrape:1 jobs: ['5355022'] 2020-08-23T09:14:54.703 INFO:scrape:suites: ['clusters/{fixed-3', 'objectstore/bluestore-comp-zstd', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2020-08-23T09:14:54.704 INFO:scrape: 2020-08-23T09:14:54.704 INFO:scrape:Failure: "2020-08-23T03:25:19.361064+0000 osd.0 (osd.0) 3 : cluster [WRN] slow request osd_op(client.12015.0:4299 3.1 3:afc62c43:::rbd_data.2eeb15120aa2.0000000000000064:head [write 892928~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e119) initiated 2020-08-23T03:24:48.795783+0000 currently reached pg" in cluster log 2020-08-23T09:14:54.705 INFO:scrape:1 jobs: ['5355102'] 2020-08-23T09:14:54.705 INFO:scrape:suites: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] 2020-08-23T09:14:54.706 INFO:scrape: 2020-08-23T09:14:54.706 INFO:scrape:Failure: Command failed on smithi123 with status 1: 'sudo yum -y install ceph-test' 2020-08-23T09:14:54.707 INFO:scrape:3 jobs: ['5355111', '5355059', '5355061'] 2020-08-23T09:14:54.707 INFO:scrape:suites intersection: ['openstack}'] 2020-08-23T09:14:54.707 INFO:scrape:suites union: ['centos_latest', 'clients/{mirror-extra', 'cluster/{2-node', 'clusters/{fixed-1', 'clusters/{fixed-2', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rbd/mirror/{base/install', 'rbd/thrash/{base/install', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'thrashers/default', 'thrashosds-health', 'validator/memcheck', 'workloads/c_api_tests}', 'workloads/rbd-mirror-bootstrap-workunit}', 'workloads/rbd_fsx_copy_on_read}'] 2020-08-23T09:14:54.709 INFO:scrape: 2020-08-23T09:14:54.709 INFO:scrape:Failure: Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi198 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e833956918923b3362942c561ac10e99c384455d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 IMAGE_NAME=client.0.1-clone adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh' 2020-08-23T09:14:54.710 INFO:scrape:1 jobs: ['5355056'] 2020-08-23T09:14:54.710 INFO:scrape:suites: ['clusters/{fixed-3', 'objectstore/bluestore-stupid', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/dynamic_features_no_cache}'] 2020-08-23T09:14:54.711 INFO:scrape: 2020-08-23T09:14:54.711 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi105 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e833956918923b3362942c561ac10e99c384455d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=125 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 2020-08-23T09:14:54.712 INFO:scrape:1 jobs: ['5355082'] 2020-08-23T09:14:54.712 INFO:scrape:suites: ['clusters/{fixed-3', 'config/copy-on-read', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'pool/none', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{centos_8}', 'workloads/c_api_tests_with_journaling}'] 2020-08-23T09:14:54.712 INFO:scrape: 2020-08-23T09:14:54.723 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 144 Fail ================================================================= [5355022] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 05:13:45 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355022/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355022/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=3bbc2f0966504bc28ebd61bc27e2ca5c Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi007 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e833956918923b3362942c561ac10e99c384455d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 IMAGE_NAME=client.0.1-clone adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_featu res.sh' [5355056] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 06:35:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355056/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355056/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=7bf4544578c44cfabfd8dd45684971a0 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi198 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e833956918923b3362942c561ac10e99c384455d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 IMAGE_NAME=client.0.1-clone adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_featu res.sh' [5355059] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355059/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355059/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=95746c057f5e41a7894c88000465f7e8 Command failed on smithi018 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5355061] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/c_api_tests} ----------------------------------------------------------------- time: 00:04:38 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355061/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355061/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8df990bdf07a4001b62f3b34e3698c7e Command failed on smithi085 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5355082] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355082/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=fb6e07df18ce46a1b120788534affcf1 Command failed (workunit test rbd/test_librbd.sh) on smithi105 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e833956918923b3362942c561ac10e99c384455d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=125 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [5355102] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:35:26 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355102/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355102/ "2020-08-23T03:25:19.361064+0000 osd.0 (osd.0) 3 : cluster [WRN] slow request osd_op(client.12015.0:4299 3.1 3:afc62c43:::rbd_data.2eeb15120aa2.0000000000000064:head [write 892928~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e119) initiated 2020-08-23T03:24:48.795783+0000 currently reached pg" in cluster log [5355111] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355111/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355111/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=9ca5583bfaa64aeaa6c973dab0040824 Command failed on smithi123 with status 1: 'sudo yum -y install ceph-test' Pass ================================================================= [5354965] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:34:21 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354965/ [5354966] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 01:51:47 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354966/ [5354967] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354967/ [5354968] rbd/singleton/{all/verify_pool objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:23:40 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354968/ [5354969] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} time: 00:31:56 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354969/ [5354970] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 02:18:36 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354970/ [5354971] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354971/ [5354972] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests_with_journaling} time: 01:26:37 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354972/ [5354973] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354973/ [5354974] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 05:50:44 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354974/ [5354975] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-bootstrap-workunit} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354975/ [5354976] rbd/singleton/{all/admin_socket objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354976/ [5354977] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/journal} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354977/ [5354978] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:34:45 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354978/ [5354979] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} time: 00:31:15 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354979/ [5354980] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354980/ [5354981] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:34:35 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354981/ [5354982] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/fsx} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354982/ [5354983] rbd/singleton/{all/formatted-output objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354983/ [5354984] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 01:31:00 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354984/ [5354985] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:40:19 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354985/ [5354986] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354986/ [5354987] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/fsx} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354987/ [5354988] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests} time: 00:41:45 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354988/ [5354989] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 05:26:12 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354989/ [5354990] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354990/ [5354991] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354991/ [5354992] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354992/ [5354993] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354993/ [5354994] rbd/singleton/{all/merge_diff objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354994/ [5354995] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} time: 00:32:22 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354995/ [5354996] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:47:16 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354996/ [5354997] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 03:41:34 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354997/ [5354998] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} time: 00:49:36 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354998/ [5354999] rbd/singleton/{all/permissions objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5354999/ [5355000] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:30:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355000/ [5355001] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{centos_8} workloads/qemu_fsstress} time: 00:35:19 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355001/ [5355002] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} time: 00:36:48 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355002/ [5355003] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/python_api_tests} time: 00:41:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355003/ [5355004] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:39:07 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355004/ [5355005] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355005/ [5355006] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:38:19 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355006/ [5355007] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} time: 00:25:00 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355007/ [5355008] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_defaults} time: 00:34:33 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355008/ [5355009] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} time: 00:59:02 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355009/ [5355010] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} time: 04:07:55 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355010/ [5355011] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} time: 00:32:40 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355011/ [5355012] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355012/ [5355013] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355013/ [5355014] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355014/ [5355015] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355015/ [5355016] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355016/ [5355017] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/python_api_tests_with_defaults} time: 00:39:24 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355017/ [5355018] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 05:42:02 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355018/ [5355019] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} time: 00:40:54 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355019/ [5355020] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355020/ [5355021] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/python_api_tests_with_journaling} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355021/ [5355023] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355023/ [5355024] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355024/ [5355025] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} time: 00:30:28 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355025/ [5355026] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:31:11 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355026/ [5355027] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/fio_on_immutable_object_cache} time: 00:28:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355027/ [5355028] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355028/ [5355029] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} time: 00:15:01 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355029/ [5355030] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355030/ [5355031] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355031/ [5355032] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests_with_journaling} time: 00:40:17 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355032/ [5355033] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} time: 00:35:00 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355033/ [5355034] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 04:16:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355034/ [5355035] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355035/ [5355036] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_fio} time: 01:15:26 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355036/ [5355037] rbd/singleton/{all/qos objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:35:48 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355037/ [5355038] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355038/ [5355039] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355039/ [5355040] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355040/ [5355041] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355041/ [5355042] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} time: 01:38:01 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355042/ [5355043] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 04:43:48 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355043/ [5355044] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355044/ [5355045] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355045/ [5355046] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} time: 01:03:25 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355046/ [5355047] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:42:01 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355047/ [5355048] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355048/ [5355049] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355049/ [5355050] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355050/ [5355051] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} time: 00:34:39 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355051/ [5355052] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:54:56 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355052/ [5355053] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:32:28 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355053/ [5355054] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355054/ [5355055] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355055/ [5355057] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:40:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355057/ [5355058] rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:21:54 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355058/ [5355060] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} time: 00:31:42 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355060/ [5355062] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} time: 02:58:47 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355062/ [5355063] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:32:08 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355063/ [5355064] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} time: 00:17:50 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355064/ [5355065] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} time: 00:36:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355065/ [5355066] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355066/ [5355067] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355067/ [5355068] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 01:37:21 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355068/ [5355069] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355069/ [5355070] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit} time: 00:37:18 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355070/ [5355071] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355071/ [5355072] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355072/ [5355073] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:31:44 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355073/ [5355074] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_cls_tests} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355074/ [5355075] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/c_api_tests_with_defaults} time: 00:51:50 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355075/ [5355076] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:36:29 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355076/ [5355077] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 03:16:38 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355077/ [5355078] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:31:39 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355078/ [5355079] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/qemu_on_immutable_object_cache_and_thrash} time: 01:18:45 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355079/ [5355080] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355080/ [5355081] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:23:09 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355081/ [5355083] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_journal} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355083/ [5355084] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355084/ [5355085] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 01:34:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355085/ [5355086] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355086/ [5355087] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 04:50:33 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355087/ [5355088] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355088/ [5355089] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355089/ [5355090] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/c_api_tests_with_journaling} time: 01:33:53 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355090/ [5355091] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355091/ [5355092] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355092/ [5355093] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nocache} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355093/ [5355094] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} time: 00:40:46 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355094/ [5355095] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:37:58 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355095/ [5355096] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355096/ [5355097] rbd/singleton/{all/snap-diff objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355097/ [5355098] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:40:59 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355098/ [5355099] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355099/ [5355100] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 05:22:18 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355100/ [5355101] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355101/ [5355103] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355103/ [5355104] rbd/singleton/{all/verify_pool objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355104/ [5355105] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:31:16 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355105/ [5355106] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/fsx} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355106/ [5355107] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 01:40:34 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355107/ [5355108] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355108/ [5355109] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355109/ [5355110] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 04:06:35 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355110/ [5355112] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit} time: 00:32:29 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355112/ [5355113] rbd/singleton/{all/admin_socket objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355113/ [5355114] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/journal} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355114/ [5355115] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2020-08-18_02:01:03-rbd-master-distro-basic-smithi/5355115/