2022-02-07T19:17:56.135 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-07T19:17:56.136 INFO:teuthology.results:subset: '52/99' 2022-02-07T19:17:56.137 INFO:teuthology.results:seed: '1341' 2022-02-07T19:18:10.978 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-07T19:18:10.982 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-07T23:49:31.442 INFO:teuthology.results:Tests finished! gathering results... 2022-02-07T23:49:33.054 INFO:scrape:Found 18 jobs 2022-02-07T23:49:33.630 INFO:scrape:Found 2 distinct failure reasons 2022-02-07T23:49:33.631 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2022-02-07T23:49:33.632 INFO:scrape:4 jobs: ['6666640', '6666642', '6666644', '6666641'] 2022-02-07T23:49:33.632 INFO:scrape:suites intersection: ['clusters/{fixed-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'workloads/rbd_cli_generic}'] 2022-02-07T23:49:33.633 INFO:scrape:suites union: ['clusters/{fixed-1', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] 2022-02-07T23:49:33.633 INFO:scrape: 2022-02-07T23:49:33.634 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2022-02-07T23:49:33.634 INFO:scrape:2 jobs: ['6666643', '6666629'] 2022-02-07T23:49:33.635 INFO:scrape:suites intersection: ['clusters/{fixed-3', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2022-02-07T23:49:33.635 INFO:scrape:suites union: ['clusters/{fixed-3', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-stupid', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2022-02-07T23:49:33.636 INFO:scrape: 2022-02-07T23:49:33.637 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 12 Fail ================================================================= [6666629] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 03:12:22 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666629/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5375440a9644540972567b6adae1cc8 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi175 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' [6666640] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:43:13 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666640/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666640/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69d2846e2ae74fed93cf6e974be94e26 Command failed (workunit test rbd/cli_generic.sh) on smithi101 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6666641] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:30:23 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666641/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666641/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68637fdaa50d48a8960f99f54dfaddd2 Command failed (workunit test rbd/cli_generic.sh) on smithi036 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6666642] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:30:32 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666642/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666642/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cba3477d6c749c3b704e1b957111e71 Command failed (workunit test rbd/cli_generic.sh) on smithi025 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6666643] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 03:13:39 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666643/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666643/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1cd52c8a016c474a9cd4d202a5bed665 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi138 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' [6666644] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:30:19 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666644/ log: http://qa-proxy.ceph.com/teuthology/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666644/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1dbe1e31542840e3b478af5b865739f1 Command failed (workunit test rbd/cli_generic.sh) on smithi120 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=80416e72f85914ce9109c892b1171f8d6cfec750 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' Pass ================================================================= [6666627] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} time: 00:17:37 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666627/ [6666628] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:07:22 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666628/ [6666630] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests} time: 00:22:28 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666630/ [6666631] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 04:21:24 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666631/ [6666632] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:50:21 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666632/ [6666633] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} time: 00:38:41 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666633/ [6666634] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/fsx} time: 00:16:30 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666634/ [6666635] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:14:52 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666635/ [6666636] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} time: 00:32:07 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666636/ [6666637] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:41:33 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666637/ [6666638] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests} time: 00:36:15 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666638/ [6666639] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} time: 00:19:31 info: http://pulpito.ceph.com/dis-2022-02-07_19:17:44-rbd-wip-rbd-quincy-batch-2-distro-default-smithi/6666639/