2021-02-03T08:30:20.854 INFO:root:teuthology version: 1.0.0-c383a14
2021-02-03T08:30:20.856 INFO:teuthology.results:subset: '978/9999'
2021-02-03T08:30:20.870 INFO:teuthology.results:seed: '2477'
2021-02-03T08:57:21.872 INFO:root:teuthology version: 1.0.0-c383a14
2021-02-03T08:57:21.934 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-02-03T12:19:25.804 INFO:teuthology.results:Tests finished! gathering results...
2021-02-03T12:19:33.568 INFO:scrape:Found 24 jobs
2021-02-03T12:19:45.652 INFO:scrape:Found 7 distinct failure reasons
2021-02-03T12:19:45.653 INFO:scrape:Failure: Test failure: test_crash_history (tasks.mgr.test_insights.TestInsights)
2021-02-03T12:19:45.653 INFO:scrape:2 jobs: ['5853633', '5853617']
2021-02-03T12:19:45.654 INFO:scrape:suites intersection: ['debug/mgr', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_8}', 'tasks/insights}']
2021-02-03T12:19:45.654 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_8}', 'tasks/insights}']
2021-02-03T12:19:45.655 INFO:scrape:
2021-02-03T12:19:45.655 INFO:scrape:Dead: b'2021-02-03T12:17:16.511 DEBUG:teuthology.exit:Finished running handlers'
2021-02-03T12:19:45.656 INFO:scrape:7 jobs: ['5853613', '5853616', '5853624', '5853610', '5853619', '5853615', '5853630']
2021-02-03T12:19:45.656 INFO:scrape:suites intersection: []
2021-02-03T12:19:45.657 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'distro$/{ubuntu_20.04}', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'openstack', 'openstack}', 'rados', 'rados/cephadm/upgrade/{1-start', 'rados/cephadm/with-work/{distro/ubuntu_20.04', 'rados/perf/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'scheduler/dmclock_default_shards', 'scheduler/wpq_default_shards', 'settings/optimized', 'start', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/default', 'thrashosds-health', 'ubuntu_latest', 'workloads/cosbench_64K_read_write}', 'workloads/cosbench_64K_write}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench_omap_write}']
2021-02-03T12:19:45.657 INFO:scrape:
2021-02-03T12:19:45.657 INFO:scrape:Failure: reached maximum tries (500) after waiting for 3000 seconds
2021-02-03T12:19:45.658 INFO:scrape:1 jobs: ['5853623']
2021-02-03T12:19:45.658 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/radosbench-high-concurrency}']
2021-02-03T12:19:45.659 INFO:scrape:
2021-02-03T12:19:45.659 INFO:scrape:Failure: Command failed on smithi082 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 598aec74-65fe-11eb-8fbe-001a4aab830c -e sha1=2f1d0e7b965fd76bc61d9186ac833de13ea48667 -- bash -c 'ceph orch ps'"
2021-02-03T12:19:45.660 INFO:scrape:2 jobs: ['5853625', '5853614']
2021-02-03T12:19:45.660 INFO:scrape:suites intersection: ['1-tasks', 'distro1$/{centos_8.0}', 'rados/upgrade/pacific-x/parallel/{0-start', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2021-02-03T12:19:45.661 INFO:scrape:suites union: ['1-tasks', 'distro1$/{centos_8.0}', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/pacific-x/parallel/{0-start', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2021-02-03T12:19:45.661 INFO:scrape:
2021-02-03T12:19:45.662 INFO:scrape:Failure: Test failure: test_stat (tasks.mgr.test_crash.TestCrash)
2021-02-03T12:19:45.662 INFO:scrape:2 jobs: ['5853628', '5853611']
2021-02-03T12:19:45.663 INFO:scrape:suites intersection: ['debug/mgr', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/crash}']
2021-02-03T12:19:45.663 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/crash}']
2021-02-03T12:19:45.663 INFO:scrape:
2021-02-03T12:19:45.664 INFO:scrape:Failure: "2021-02-03T09:01:44.427937+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4194.0:136 10.1a 10.4b6c2efa (undecoded) ondisk+retry+write+known_if_redirected e41) initiated 2021-02-03T09:01:13.644967+0000 currently queued for pg" in cluster log
2021-02-03T12:19:45.664 INFO:scrape:1 jobs: ['5853622']
2021-02-03T12:19:45.665 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'supported-random-distro$/{rhel_8}}']
2021-02-03T12:19:45.665 INFO:scrape:
2021-02-03T12:19:45.666 INFO:scrape:Failure: Exiting scrub checking -- not all pgs scrubbed.
2021-02-03T12:19:45.666 INFO:scrape:1 jobs: ['5853626']
2021-02-03T12:19:45.667 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/cache-pool-snaps-readproxy}']
2021-02-03T12:19:45.667 INFO:scrape:
2021-02-03T12:19:45.669 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/
failed:  9
dead:    7
running: 0
waiting: 0
queued:  0
passed:  8


Fail
=================================================================
[5853611]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/crash}
-----------------------------------------------------------------
time:   00:09:11
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853611/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853611/
sentry: https://sentry.ceph.com/organizations/ceph/?query=004f421141524af295d09a9053170ffe

    Test failure: test_stat (tasks.mgr.test_crash.TestCrash)

[5853614]  rados/upgrade/pacific-x/parallel/{0-start 1-tasks distro1$/{centos_8.0} mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   01:59:34
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853614/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853614/
sentry: https://sentry.ceph.com/organizations/ceph/?query=217b00872c7d414d8164b1e14f14e803

    Command failed on smithi053 with status 1: "sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-
    pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring
    --fsid ae7c9b02-65fd-11eb-8fbe-001a4aab830c -e
    sha1=2f1d0e7b965fd76bc61d9186ac833de13ea48667 -- bash -c 'ceph orch ps'"

[5853617]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/insights}
-----------------------------------------------------------------
time:   00:11:27
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853617/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853617/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1a6c1279012442f69976fc0cb4d1047e

    Test failure: test_crash_history (tasks.mgr.test_insights.TestInsights)

[5853622]  rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:24:56
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853622/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853622/

    "2021-02-03T09:01:44.427937+0000 osd.1 (osd.1) 3 : cluster [WRN] slow
    request osd_op(client.4194.0:136 10.1a 10.4b6c2efa (undecoded)
    ondisk+retry+write+known_if_redirected e41) initiated
    2021-02-03T09:01:13.644967+0000 currently queued for pg" in cluster log

[5853623]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   02:24:31
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853623/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=17cd827ca69144a08674aa927d687adc

    reached maximum tries (500) after waiting for 3000 seconds

[5853625]  rados/upgrade/pacific-x/parallel/{0-start 1-tasks distro1$/{centos_8.0} mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   01:57:40
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853625/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853625/
sentry: https://sentry.ceph.com/organizations/ceph/?query=39cc0beebcd94381895f826de2580a02

    Command failed on smithi082 with status 1: "sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-
    pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring
    --fsid 598aec74-65fe-11eb-8fbe-001a4aab830c -e
    sha1=2f1d0e7b965fd76bc61d9186ac833de13ea48667 -- bash -c 'ceph orch ps'"

[5853626]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
-----------------------------------------------------------------
time:   00:40:46
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853626/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853626/

    Exiting scrub checking -- not all pgs scrubbed.

[5853628]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/crash}
-----------------------------------------------------------------
time:   00:09:24
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853628/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853628/
sentry: https://sentry.ceph.com/organizations/ceph/?query=45999199a66c4323b17abc2bbfa19a9a

    Test failure: test_stat (tasks.mgr.test_crash.TestCrash)

[5853633]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/insights}
-----------------------------------------------------------------
time:   00:11:25
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853633/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853633/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ba1ca4d990948dba79391e191a58154

    Test failure: test_crash_history (tasks.mgr.test_insights.TestInsights)



Dead
=================================================================
[5853610]  rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853610/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853610/

[5853613]  rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853613/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853613/

[5853615]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853615/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853615/

[5853616]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853616/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853616/

[5853619]  rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853619/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853619/

[5853624]  rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853624/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853624/

[5853630]  rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_20.04} fixed-2 mon_election/connectivity}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853630/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853630/



Pass
=================================================================
[5853612] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:37:58
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853612/

[5853618] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_20.04} fixed-2 mon_election/connectivity}
time:   00:19:35
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853618/

[5853620] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect}
time:   00:14:11
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853620/

[5853621] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   00:10:41
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853621/

[5853627] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:26:22
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853627/

[5853629] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:43:13
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853629/

[5853631] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:10:02
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853631/

[5853632] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:06:19
info:   http://pulpito.ceph.com/kchai-2021-02-03_08:10:00-rados-wip-kefu-testing-2021-02-03-1357-distro-basic-smithi/5853632/