2022-08-14T06:51:28.212 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc
2022-08-14T06:51:28.216 INFO:teuthology.results:subset: '76/99'
2022-08-14T06:51:28.216 INFO:teuthology.results:seed: '5545'
2022-08-14T07:23:13.948 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc
2022-08-14T07:23:13.977 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-08-14T10:02:26.352 INFO:teuthology.results:Tests finished! gathering results...
2022-08-14T10:02:28.073 INFO:scrape:Found 20 jobs
2022-08-14T10:02:29.255 INFO:scrape:Found 1 distinct failure reasons
2022-08-14T10:02:29.256 INFO:scrape:Failure: "2022-08-14T07:49:29.399456+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3577 objects degraded (0.028%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-08-14T10:02:29.257 INFO:scrape:5 jobs: ['6971520', '6971509', '6971507', '6971506', '6971504']
2022-08-14T10:02:29.258 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}']
2022-08-14T10:02:29.259 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'features/layering', 'min-compat-client/default', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'pool/ec-data-pool', 'pool/none', 'rbd-mirror/four-per-cluster', 'rbd/cli/{base/install', 'rbd/librbd/{cache/none', 'rbd/librbd/{cache/writethrough', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd_cli_generic}']
2022-08-14T10:02:29.259 INFO:scrape:
2022-08-14T10:02:29.260 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  15


Fail
=================================================================
[6971504]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit}
-----------------------------------------------------------------
time:   00:46:57
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971504/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971504/

    "2022-08-14T07:14:19.624776+0000 mon.a (mon.0) 216 : cluster [WRN] Health
    check failed: Degraded data redundancy: 11/3640 objects degraded (0.302%),
    2 pgs degraded (PG_DEGRADED)" in cluster log

[6971506]  rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling}
-----------------------------------------------------------------
time:   00:35:03
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971506/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971506/

    "2022-08-14T07:31:33.949618+0000 mon.a (mon.0) 886 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[6971507]  rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic}
-----------------------------------------------------------------
time:   00:19:37
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971507/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971507/
sentry: https://sentry.ceph.com/organizations/ceph/?query=664b3c54c33b4448a67872232eeda33e

    "2022-08-14T07:17:31.850278+0000 mon.a (mon.0) 92 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6971509]  rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults}
-----------------------------------------------------------------
time:   00:28:02
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971509/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971509/

    "2022-08-14T07:24:12.159578+0000 mon.a (mon.0) 233 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in
    cluster log

[6971520]  rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling}
-----------------------------------------------------------------
time:   00:34:17
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971520/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971520/

    "2022-08-14T07:49:29.399456+0000 mon.a (mon.0) 760 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1/3577 objects degraded (0.028%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Pass
=================================================================
[6971501] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup}
time:   02:09:50
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971501/

[6971502] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests}
time:   01:04:33
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971502/

[6971503] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:25:15
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971503/

[6971505] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests}
time:   00:19:49
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971505/

[6971508] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests}
time:   02:49:31
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971508/

[6971510] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:13:05
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971510/

[6971511] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests}
time:   01:04:23
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971511/

[6971512] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{centos_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup}
time:   01:58:26
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971512/

[6971513] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling}
time:   00:35:12
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971513/

[6971514] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_migration}
time:   00:34:46
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971514/

[6971515] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_defaults}
time:   00:23:53
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971515/

[6971516] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests}
time:   01:11:42
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971516/

[6971517] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie}
time:   00:30:41
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971517/

[6971518] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults}
time:   00:28:29
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971518/

[6971519] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling}
time:   00:31:58
info:   http://pulpito.ceph.com/dis-2022-08-14_06:49:31-rbd-wip-dis-testing-1-distro-default-smithi/6971519/