2022-06-28T19:50:32.912 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-06-28T19:50:32.915 INFO:teuthology.results:subset: '43/99'
2022-06-28T19:50:32.916 INFO:teuthology.results:seed: '4259'
2022-06-28T20:30:03.072 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-06-28T20:30:03.099 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-29T00:11:22.474 INFO:teuthology.results:Tests finished! gathering results...
2022-06-29T00:11:25.418 INFO:scrape:Found 22 jobs
2022-06-29T00:11:26.746 INFO:scrape:Found 2 distinct failure reasons
2022-06-29T00:11:26.750 INFO:scrape:Failure: "2022-06-28T20:17:39.571973+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Degraded data redundancy: 4/3314 objects degraded (0.121%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-06-29T00:11:26.751 INFO:scrape:2 jobs: ['6904074', '6904082']
2022-06-29T00:11:26.753 INFO:scrape:suites intersection: ['msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}']
2022-06-29T00:11:26.754 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'clusters/{fixed-3', 'config/copy-on-read', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'policy/none', 'pool/ec-data-pool', 'rbd-mirror/four-per-cluster', 'rbd/librbd/{cache/none', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/c_api_tests_with_journaling}', 'workloads/rbd-mirror-fsx-workunit}']
2022-06-29T00:11:26.755 INFO:scrape:
2022-06-29T00:11:26.756 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2022-06-29T00:11:26.757 INFO:scrape:1 jobs: ['6904075']
2022-06-29T00:11:26.761 INFO:scrape:suites: ['clusters/{fixed-3', 'config/none', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'pool/ec-data-pool', 'rbd/librbd/{cache/writethrough', 'supported-random-distro$/{centos_8}', 'workloads/c_api_tests_with_defaults}']
2022-06-29T00:11:26.762 INFO:scrape:
2022-06-29T00:11:26.764 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  19


Fail
=================================================================
[6904074]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit}
-----------------------------------------------------------------
time:   00:39:37
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904074/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904074/

    "2022-06-28T20:17:39.571973+0000 mon.a (mon.0) 199 : cluster [WRN] Health
    check failed: Degraded data redundancy: 4/3314 objects degraded (0.121%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6904075]  rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults}
-----------------------------------------------------------------
time:   00:18:39
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904075/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904075/
sentry: https://sentry.ceph.com/organizations/ceph/?query=97171c9d499e4b92a00094628826e619

    reached maximum tries (90) after waiting for 540 seconds

[6904082]  rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling}
-----------------------------------------------------------------
time:   00:32:04
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904082/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904082/

    "2022-06-28T20:39:54.741586+0000 mon.a (mon.0) 752 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1/3581 objects degraded (0.028%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Pass
=================================================================
[6904068] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/c_api_tests}
time:   00:27:02
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904068/

[6904069] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling}
time:   00:31:58
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904069/

[6904070] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults}
time:   00:25:10
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904070/

[6904071] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}}
time:   00:23:34
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904071/

[6904072] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests}
time:   04:10:24
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904072/

[6904073] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests}
time:   00:24:30
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904073/

[6904076] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/fsx}
time:   00:16:01
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904076/

[6904077] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic}
time:   00:19:30
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904077/

[6904078] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults}
time:   00:26:29
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904078/

[6904079] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup}
time:   01:26:39
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904079/

[6904080] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie}
time:   00:18:40
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904080/

[6904081] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic}
time:   00:21:58
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904081/

[6904083] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests}
time:   01:04:33
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904083/

[6904084] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd}
time:   00:08:56
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904084/

[6904085] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking}
time:   00:28:42
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904085/

[6904086] rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/c_api_tests_with_defaults}
time:   00:25:37
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904086/

[6904087] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling}
time:   00:34:05
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904087/

[6904088] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling}
time:   00:31:44
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904088/

[6904089] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_journal}
time:   00:17:02
info:   http://pulpito.ceph.com/dis-2022-06-28_19:48:57-rbd-wip-dis-testing-distro-default-smithi/6904089/