2021-08-22T15:23:37.774 INFO:root:teuthology version: 1.1.0-321319b1
2021-08-22T15:23:37.777 INFO:teuthology.results:subset: '15/99'
2021-08-22T15:23:37.777 INFO:teuthology.results:seed: '387'
2021-08-22T15:24:25.131 INFO:root:teuthology version: 1.1.0-321319b1
2021-08-22T15:24:25.137 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-08-22T20:05:42.870 INFO:teuthology.results:Tests finished! gathering results...
2021-08-22T20:05:43.419 INFO:scrape:Found 22 jobs
2021-08-22T20:05:43.680 INFO:scrape:Found 2 distinct failure reasons
2021-08-22T20:05:43.681 INFO:scrape:Failure: "2021-08-22T15:43:49.292826+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
2021-08-22T20:05:43.682 INFO:scrape:2 jobs: ['6351759', '6351760']
2021-08-22T20:05:43.682 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}']
2021-08-22T20:05:43.682 INFO:scrape:suites union: ['cachepool/none', 'clients/{mirror-extra', 'cluster/{2-node', 'clusters/{fixed-1', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'openstack}', 'rbd/basic/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rbd_lock_and_fence}', 'workloads/rbd-mirror-snapshot-workunit-journaling}']
2021-08-22T20:05:43.683 INFO:scrape:
2021-08-22T20:05:43.683 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2021-08-22T20:05:43.684 INFO:scrape:2 jobs: ['6351746', '6351749']
2021-08-22T20:05:43.684 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}']
2021-08-22T20:05:43.685 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'clusters/{fixed-3', 'config/permit-partial-discard', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'openstack}', 'policy/none', 'pool/replicated-data-pool', 'rbd-mirror/four-per-cluster', 'rbd/librbd/{cache/writearound', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}']
2021-08-22T20:05:43.685 INFO:scrape:
2021-08-22T20:05:43.686 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/
failed:  4
dead:    0
running: 0
waiting: 0
queued:  0
passed:  18


Fail
=================================================================
[6351746]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
-----------------------------------------------------------------
time:   00:16:44
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351746/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351746/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2bf7aade3c3f4724a13ee6b2fda0256e

    reached maximum tries (90) after waiting for 540 seconds

[6351749]  rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/c_api_tests}
-----------------------------------------------------------------
time:   00:19:48
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351749/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351749/
sentry: https://sentry.ceph.com/organizations/ceph/?query=10dcb3d4437c469781ce979687b619b1

    reached maximum tries (90) after waiting for 540 seconds

[6351759]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
-----------------------------------------------------------------
time:   00:17:15
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351759/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351759/

    "2021-08-22T15:43:49.292826+0000 mon.a (mon.0) 206 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in
    cluster log

[6351760]  rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence}
-----------------------------------------------------------------
time:   00:17:05
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351760/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351760/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b6f7258e94f545c1884d857d85be92b0

    "2021-08-22T15:40:47.441944+0000 mon.a (mon.0) 108 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Pass
=================================================================
[6351743] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd}
time:   00:15:53
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351743/

[6351744] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{centos_8.stream} workloads/c_api_tests_with_journaling}
time:   00:31:16
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351744/

[6351745] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/python_api_tests_with_defaults}
time:   00:21:53
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351745/

[6351747] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd}
time:   00:34:43
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351747/

[6351748] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1}
time:   02:28:53
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351748/

[6351750] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults}
time:   00:26:15
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351750/

[6351751] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling}
time:   00:31:54
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351751/

[6351752] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling}
time:   00:42:13
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351752/

[6351753] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-fsx-workunit}
time:   00:42:55
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351753/

[6351754] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rbd_nbd}
time:   00:11:57
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351754/

[6351755] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}}
time:   00:09:43
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351755/

[6351756] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_fio}
time:   00:26:44
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351756/

[6351757] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/rbd_cls_tests}
time:   00:10:48
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351757/

[6351758] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_migration}
time:   00:31:26
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351758/

[6351761] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit}
time:   00:12:40
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351761/

[6351762] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic}
time:   00:34:04
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351762/

[6351763] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd}
time:   00:29:38
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351763/

[6351764] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2}
time:   04:28:44
info:   http://pulpito.ceph.com/dis-2021-08-22_15:23:26-rbd-wip-dis-testing-1-distro-basic-smithi/6351764/