2020-09-27T14:42:42.427 INFO:root:teuthology version: 1.0.0-75888fc
2020-09-27T14:42:42.429 INFO:teuthology.results:subset: '889/9999'
2020-09-27T14:42:42.429 INFO:teuthology.results:seed: '2477'
2020-09-27T15:05:03.303 INFO:root:teuthology version: 1.0.0-75888fc
2020-09-27T15:05:03.331 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-09-28T03:05:17.098 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2020-09-28T03:05:24.276 INFO:scrape:Found 48 jobs
2020-09-28T03:05:24.717 INFO:scrape:Found 2 distinct failure reasons
2020-09-28T03:05:24.718 INFO:scrape:Failure: Command failed on smithi143 with status 5: 'sudo systemctl stop ceph-bc6e6cb2-00d2-11eb-a2aa-001a4aab830c@mon.a'
2020-09-28T03:05:24.718 INFO:scrape:3 jobs: ['5474353', '5474338', '5474357']
2020-09-28T03:05:24.719 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start']
2020-09-28T03:05:24.719 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start']
2020-09-28T03:05:24.719 INFO:scrape:
2020-09-28T03:05:24.720 INFO:scrape:Dead: b'2020-09-28T03:03:33.793 DEBUG:teuthology.exit:Finished running handlers'
2020-09-28T03:05:24.720 INFO:scrape:2 jobs: ['5474367', '5474339']
2020-09-28T03:05:24.720 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'thrashosds-health}', 'validater/valgrind}']
2020-09-28T03:05:24.721 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}']
2020-09-28T03:05:24.721 INFO:scrape:
2020-09-28T03:05:24.723 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/
failed:  3
dead:    1
running: 1
waiting: 0
queued:  0
passed:  43


Fail
=================================================================
[5474338]  rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic}
-----------------------------------------------------------------
time:   00:02:02
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474338/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474338/
sentry: https://sentry.ceph.com/sentry/sepia/?query=86bfbf8eeba6496797e2c6abab53e11c

    Command failed on smithi119 with status 5: 'sudo systemctl stop
    ceph-22da3644-00d2-11eb-a2aa-001a4aab830c@mon.a'

[5474353]  rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic}
-----------------------------------------------------------------
time:   00:02:03
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474353/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474353/
sentry: https://sentry.ceph.com/sentry/sepia/?query=d75fa5f9df0547c282c08597ac76c226

    Command failed on smithi143 with status 5: 'sudo systemctl stop ceph-
    bc6e6cb2-00d2-11eb-a2aa-001a4aab830c@mon.a'

[5474357]  rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity}
-----------------------------------------------------------------
time:   00:02:02
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474357/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474357/
sentry: https://sentry.ceph.com/sentry/sepia/?query=c2e99edcf3614c90bd2be8a2f20f9ddd

    Command failed on smithi120 with status 5: 'sudo systemctl stop ceph-
    dd3682d6-00d2-11eb-a2aa-001a4aab830c@mon.a'



Dead
=================================================================
[5474339]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474339/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474339/



Running
=================================================================
[5474367] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind}
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474367/



Pass
=================================================================
[5474324] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps}
time:   00:19:31
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474324/

[5474325] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:22:20
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474325/

[5474326] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache}
time:   00:13:14
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474326/

[5474327] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:06:23
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474327/

[5474328] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic}
time:   00:16:27
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474328/

[5474329] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect}
time:   00:09:48
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474329/

[5474330] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests}
time:   00:13:34
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474330/

[5474331] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity}
time:   00:18:43
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474331/

[5474332] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small}
time:   00:08:56
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474332/

[5474333] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps}
time:   00:28:33
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474333/

[5474334] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced}
time:   00:22:23
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474334/

[5474335] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:31:18
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474335/

[5474336] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   00:27:42
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474336/

[5474337] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache}
time:   00:09:24
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474337/

[5474340] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:11:21
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474340/

[5474341] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object}
time:   00:12:47
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474341/

[5474342] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:15:16
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474342/

[5474343] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:38:10
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474343/

[5474344] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity}
time:   00:14:22
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474344/

[5474345] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
time:   00:10:50
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474345/

[5474346] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:20:43
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474346/

[5474347] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
time:   00:21:56
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474347/

[5474348] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:20:48
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474348/

[5474349] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:32:39
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474349/

[5474350] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest}
time:   05:06:44
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474350/

[5474351] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect}
time:   00:15:44
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474351/

[5474352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object}
time:   00:12:41
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474352/

[5474354] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:10:56
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474354/

[5474355] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps}
time:   00:20:32
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474355/

[5474356] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:19:19
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474356/

[5474358] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache}
time:   00:10:35
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474358/

[5474359] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect}
time:   00:14:17
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474359/

[5474360] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests}
time:   00:11:22
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474360/

[5474361] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   00:27:41
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474361/

[5474362] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic}
time:   00:17:33
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474362/

[5474363] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:10
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474363/

[5474364] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small}
time:   00:16:13
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474364/

[5474365] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:21:57
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474365/

[5474366] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced}
time:   00:21:35
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474366/

[5474368] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache}
time:   00:08:44
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474368/

[5474369] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity}
time:   00:19:05
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474369/

[5474370] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:12:34
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474370/

[5474371] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:17:18
info:   http://pulpito.ceph.com/kchai-2020-09-27_14:40:39-rados-wip-kefu-testing-2020-09-25-2325-distro-basic-smithi/5474371/