2022-06-29T07:19:32.309 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-06-29T07:19:32.311 INFO:teuthology.results:subset: '43/99' 2022-06-29T07:19:32.312 INFO:teuthology.results:seed: '4259' 2022-06-29T07:24:15.248 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-06-29T07:24:15.251 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-29T10:43:30.797 INFO:teuthology.results:Tests finished! gathering results... 2022-06-29T10:43:31.086 INFO:scrape:Found 3 jobs 2022-06-29T10:43:31.882 INFO:scrape:Found 2 distinct failure reasons 2022-06-29T10:43:31.883 INFO:scrape:Failure: "2022-06-29T07:37:37.524315+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-06-29T10:43:31.883 INFO:scrape:1 jobs: ['6904949'] 2022-06-29T10:43:31.884 INFO:scrape:suites: ['clusters/{fixed-3', 'config/copy-on-read', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/ec-data-pool', 'rbd/librbd/{cache/none', 'supported-random-distro$/{centos_8}', 'workloads/c_api_tests_with_journaling}'] 2022-06-29T10:43:31.884 INFO:scrape: 2022-06-29T10:43:31.885 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd.sh 2022-06-29T10:43:31.885 INFO:scrape:1 jobs: ['6904948'] 2022-06-29T10:43:31.885 INFO:scrape:suites: ['clusters/{fixed-3', 'config/none', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'pool/ec-data-pool', 'rbd/librbd/{cache/writethrough', 'supported-random-distro$/{centos_8}', 'workloads/c_api_tests_with_defaults}'] 2022-06-29T10:43:31.886 INFO:scrape: 2022-06-29T10:43:31.887 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [6904948] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 03:14:54 info: http://pulpito.ceph.com/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/6904948/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/6904948/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8af240a1d8548ee803f02fb417fea68 Command failed (workunit test rbd/test_librbd.sh) on smithi075 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e4bc4205afae2900230c8c264de3a81b2f55133b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6904949] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:18:25 info: http://pulpito.ceph.com/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/6904949/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/6904949/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f863985347664219b7efb895aaca2880 "2022-06-29T07:37:37.524315+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Pass ================================================================= [6904947] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} time: 00:40:08 info: http://pulpito.ceph.com/dis-2022-06-29_07:19:12-rbd-wip-dis-testing-distro-default-smithi/6904947/