2022-05-30T02:01:45.043 INFO:root:teuthology version: 1.1.1.dev348+g8df7ff2b 2022-05-30T02:01:45.044 INFO:teuthology.results:subset: '6574/100000' 2022-05-30T02:01:45.044 INFO:teuthology.results:seed: '5890' 2022-05-30T04:39:10.398 INFO:root:teuthology version: 1.1.1.dev348+g8df7ff2b 2022-05-30T04:39:10.420 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-30T11:18:44.619 INFO:teuthology.results:Tests finished! gathering results... 2022-05-30T11:18:57.530 INFO:scrape:Found 179 jobs 2022-05-30T11:19:02.859 INFO:scrape:Found 7 distinct failure reasons 2022-05-30T11:19:02.859 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2022-05-30T11:19:02.860 INFO:scrape:4 jobs: ['6852778', '6852717', '6852748', '6852827'] 2022-05-30T11:19:02.860 INFO:scrape:suites intersection: ['clusters/{fixed-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'workloads/rbd_cli_generic}'] 2022-05-30T11:19:02.860 INFO:scrape:suites union: ['clusters/{fixed-1', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] 2022-05-30T11:19:02.860 INFO:scrape: 2022-05-30T11:19:02.860 INFO:scrape:Dead: b'2022-05-30T11:08:31.327 DEBUG:teuthology.exit:Finished running handlers' 2022-05-30T11:19:02.860 INFO:scrape:2 jobs: ['6852875', '6852848'] 2022-05-30T11:19:02.861 INFO:scrape:suites intersection: ['openstack}'] 2022-05-30T11:19:02.861 INFO:scrape:suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-pool/big-cache', '5-cache-mode/rwl', '6-workloads/qemu_xfstests}', 'clusters/{fixed-3', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'pool/none', 'rbd/persistent-writeback-cache/{1-base/install', 'rbd/qemu/{cache/writethrough', 'supported-random-distro$/{ubuntu_latest}', 'workloads/qemu_xfstests}'] 2022-05-30T11:19:02.861 INFO:scrape: 2022-05-30T11:19:02.861 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-05-30T11:19:02.861 INFO:scrape:4 jobs: ['6852803', '6852780', '6852790', '6852727'] 2022-05-30T11:19:02.861 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}'] 2022-05-30T11:19:02.861 INFO:scrape:suites union: ['clusters/{fixed-2', 'clusters/{fixed-3', 'config/permit-partial-discard', 'features/defaults', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/none', 'pool/replicated-data-pool', 'rbd/encryption/{cache/writearound', 'rbd/librbd/{cache/none', 'rbd/qemu/{cache/writethrough', 'rbd/thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/qemu_fsstress}', 'workloads/qemu_xfstests_luks1}', 'workloads/rbd_api_tests_journaling}', 'workloads/rbd_fio}'] 2022-05-30T11:19:02.862 INFO:scrape: 2022-05-30T11:19:02.862 INFO:scrape:Failure: "2022-05-30T02:24:05.965311+0000 mon.a (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-05-30T11:19:02.862 INFO:scrape:5 jobs: ['6852747', '6852714', '6852791', '6852858', '6852854'] 2022-05-30T11:19:02.862 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}'] 2022-05-30T11:19:02.862 INFO:scrape:suites union: ['cachepool/small', 'clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'clusters/{fixed-3', 'config/copy-on-read', 'config/permit-partial-discard', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'openstack}', 'policy/none', 'pool/ec-data-pool', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/librbd/{cache/writethrough', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_lock_and_fence}', 'workloads/c_api_tests_with_journaling}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}'] 2022-05-30T11:19:02.862 INFO:scrape: 2022-05-30T11:19:02.862 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2022-05-30T11:19:02.863 INFO:scrape:1 jobs: ['6852704'] 2022-05-30T11:19:02.863 INFO:scrape:suites: ['clusters/{fixed-3', 'objectstore/bluestore-comp-zstd', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2022-05-30T11:19:02.863 INFO:scrape: 2022-05-30T11:19:02.863 INFO:scrape:Failure: Command failed on smithi146 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2022-05-30T11:19:02.863 INFO:scrape:1 jobs: ['6852849'] 2022-05-30T11:19:02.863 INFO:scrape:suites: ['clusters/{fixed-3', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rebuild_object_map}'] 2022-05-30T11:19:02.863 INFO:scrape: 2022-05-30T11:19:02.863 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_fsx_compare.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_compare.sh' 2022-05-30T11:19:02.864 INFO:scrape:1 jobs: ['6852708'] 2022-05-30T11:19:02.864 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}'] 2022-05-30T11:19:02.864 INFO:scrape: 2022-05-30T11:19:02.871 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/ failed: 16 dead: 2 running: 0 waiting: 0 queued: 0 passed: 161 Fail ================================================================= [6852704] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 03:28:19 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852704/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b98823288ad340c4947f9bf6a3b89259 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi156 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' [6852708] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 02:53:06 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852708/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852708/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ba237513f9e45a08253a4e0b7e0469e Command failed (workunit test rbd/rbd_mirror_fsx_compare.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror _fsx_compare.sh' [6852714] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:45:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852714/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852714/ "2022-05-30T02:45:56.659546+0000 mon.a (mon.0) 740 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3577 objects degraded (0.028%), 1 pg degraded (PG_DEGRADED)" in cluster log [6852717] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:45:41 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852717/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852717/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7850a54a70004c5fa78d9d0eca1bac96 Command failed (workunit test rbd/cli_generic.sh) on smithi081 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6852727] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_journaling} ----------------------------------------------------------------- time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852727/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852727/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36cac38e9efd41a8be0f59bf028a9d14 reached maximum tries (90) after waiting for 540 seconds [6852747] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852747/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc92d925d51b4fb9a5fe2115fdd7e7ce "2022-05-30T02:24:05.965311+0000 mon.a (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6852748] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:50:31 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852748/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852748/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c0563aa68494582a71d10cc09745c2a Command failed (workunit test rbd/cli_generic.sh) on smithi067 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6852778] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:34:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852778/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852778/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f6f403e3db04dd284146bf96a683d9e Command failed (workunit test rbd/cli_generic.sh) on smithi092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6852780] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852780/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852780/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e8a871dcc23493a986e474c58cdfd12 reached maximum tries (90) after waiting for 540 seconds [6852790] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852790/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852790/ sentry: https://sentry.ceph.com/organizations/ceph/?query=318f68bee15c41ddb6e735c648577112 reached maximum tries (90) after waiting for 540 seconds [6852791] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 01:00:53 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852791/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852791/ "2022-05-30T03:20:07.207017+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [6852803] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{centos_8} workloads/rbd_fio} ----------------------------------------------------------------- time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852803/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852803/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd683d99ba65411fb5052c307dde9d2f reached maximum tries (90) after waiting for 540 seconds [6852827] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:20:05 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852827/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852827/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26bc0ace25124f089d553f1cd52f9462 Command failed (workunit test rbd/cli_generic.sh) on smithi145 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d5fe31a530fe6cfdad42a875e11a1ed21a1c61c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6852849] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 01:23:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852849/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852849/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79f52cfd5b2849c9b3c01714d7b293f1 Command failed on smithi146 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [6852854] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852854/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852854/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa092f0fea3d4fefa996af7cec83f632 "2022-05-30T04:19:32.372502+0000 mon.a (mon.0) 91 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6852858] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:40:59 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852858/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852858/ "2022-05-30T04:39:29.358955+0000 mon.a (mon.0) 805 : cluster [WRN] Health check failed: Degraded data redundancy: 1/2964 objects degraded (0.034%), 1 pg degraded (PG_DEGRADED)" in cluster log Dead ================================================================= [6852848] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852848/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852848/ hit max job timeout [6852875] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852875/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852875/ hit max job timeout Pass ================================================================= [6852703] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests} time: 00:39:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852703/ [6852705] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852705/ [6852706] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/fio} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852706/ [6852707] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:41:54 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852707/ [6852709] rbd/singleton/{all/merge_diff objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852709/ [6852710] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:26:14 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852710/ [6852711] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/fio_on_immutable_object_cache} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852711/ [6852712] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852712/ [6852713] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/python_api_tests_with_journaling} time: 00:47:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852713/ [6852715] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:38:15 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852715/ [6852716] rbd/singleton/{all/mon-command-help objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852716/ [6852718] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:38:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852718/ [6852719] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 03:17:45 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852719/ [6852720] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852720/ [6852721] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_migration} time: 00:42:04 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852721/ [6852722] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 01:19:53 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852722/ [6852723] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:19:55 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852723/ [6852724] rbd/singleton/{all/permissions objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852724/ [6852725] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} time: 00:32:22 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852725/ [6852726] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:15:56 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852726/ [6852728] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:33:05 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852728/ [6852729] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} time: 01:06:50 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852729/ [6852730] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 02:39:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852730/ [6852731] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:30:41 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852731/ [6852732] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/fsx} time: 00:39:54 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852732/ [6852733] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852733/ [6852734] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:31:06 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852734/ [6852735] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852735/ [6852736] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852736/ [6852737] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 02:14:54 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852737/ [6852738] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/qemu_xfstests} time: 01:50:27 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852738/ [6852739] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests_no_locking} time: 00:50:28 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852739/ [6852740] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:45:45 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852740/ [6852741] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:35:59 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852741/ [6852742] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852742/ [6852743] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} time: 02:33:15 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852743/ [6852744] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:58:08 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852744/ [6852745] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:39:42 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852745/ [6852746] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:33:31 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852746/ [6852749] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852749/ [6852750] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests} time: 00:58:47 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852750/ [6852751] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/python_api_tests} time: 00:43:22 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852751/ [6852752] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852752/ [6852753] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852753/ [6852754] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852754/ [6852755] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 05:25:47 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852755/ [6852756] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 01:20:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852756/ [6852757] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:33:28 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852757/ [6852758] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:59:43 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852758/ [6852759] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852759/ [6852760] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:40:01 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852760/ [6852761] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:31:15 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852761/ [6852762] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852762/ [6852763] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:22:59 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852763/ [6852764] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:27:11 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852764/ [6852765] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852765/ [6852766] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_defaults} time: 00:45:23 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852766/ [6852767] rbd/singleton/{all/qos objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} time: 00:37:19 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852767/ [6852768] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852768/ [6852769] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/qemu_on_immutable_object_cache_and_thrash} time: 01:03:05 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852769/ [6852770] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 02:04:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852770/ [6852771] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:34:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852771/ [6852772] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852772/ [6852773] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} time: 02:13:02 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852773/ [6852774] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/recovery} time: 00:23:29 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852774/ [6852775] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:44 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852775/ [6852776] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852776/ [6852777] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852777/ [6852779] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:27:05 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852779/ [6852781] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:10:39 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852781/ [6852782] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} time: 00:22:25 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852782/ [6852783] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/c_api_tests_with_journaling} time: 00:57:25 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852783/ [6852784] rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:55:05 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852784/ [6852785] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} time: 01:37:15 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852785/ [6852786] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 01:05:48 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852786/ [6852787] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} time: 00:20:52 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852787/ [6852788] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852788/ [6852789] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852789/ [6852792] rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852792/ [6852793] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852793/ [6852794] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852794/ [6852795] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 06:01:32 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852795/ [6852796] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:16:39 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852796/ [6852797] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:28:03 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852797/ [6852798] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:23:12 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852798/ [6852799] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852799/ [6852800] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/fsx} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852800/ [6852801] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852801/ [6852802] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852802/ [6852804] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852804/ [6852805] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852805/ [6852806] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/c_api_tests_with_defaults} time: 00:46:50 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852806/ [6852807] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:39:30 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852807/ [6852808] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_migration} time: 00:31:48 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852808/ [6852809] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 01:20:24 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852809/ [6852810] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852810/ [6852811] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 01:32:12 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852811/ [6852812] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:34:17 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852812/ [6852813] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} time: 00:30:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852813/ [6852814] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852814/ [6852815] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:31:49 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852815/ [6852816] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852816/ [6852817] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} time: 00:32:27 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852817/ [6852818] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests} time: 00:32:20 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852818/ [6852819] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests} time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852819/ [6852820] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852820/ [6852821] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852821/ [6852822] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} time: 01:43:53 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852822/ [6852823] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852823/ [6852824] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:05:40 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852824/ [6852825] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852825/ [6852826] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852826/ [6852828] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 04:13:34 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852828/ [6852829] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} time: 00:26:44 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852829/ [6852830] rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:29:20 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852830/ [6852831] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852831/ [6852832] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852832/ [6852833] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:40:31 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852833/ [6852834] rbd/singleton/{all/snap-diff objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852834/ [6852835] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_cls_tests} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852835/ [6852836] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_defaults} time: 00:32:26 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852836/ [6852837] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:31:34 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852837/ [6852838] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852838/ [6852839] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:21:45 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852839/ [6852840] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:36:03 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852840/ [6852841] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:25:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852841/ [6852842] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} time: 00:38:35 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852842/ [6852843] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:35:14 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852843/ [6852844] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio} time: 00:38:25 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852844/ [6852845] rbd/singleton/{all/verify_pool objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852845/ [6852846] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852846/ [6852847] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} time: 03:39:24 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852847/ [6852850] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:16:56 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852850/ [6852851] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852851/ [6852852] rbd/singleton/{all/admin_socket objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852852/ [6852853] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/journal} time: 00:22:24 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852853/ [6852855] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852855/ [6852856] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852856/ [6852857] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests_with_journaling} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852857/ [6852859] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:59:32 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852859/ [6852860] rbd/singleton/{all/formatted-output objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852860/ [6852861] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852861/ [6852862] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 01:24:38 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852862/ [6852863] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} time: 00:42:40 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852863/ [6852864] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 03:07:17 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852864/ [6852865] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:23:11 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852865/ [6852866] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852866/ [6852867] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852867/ [6852868] rbd/singleton/{all/merge_diff objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852868/ [6852869] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:17:33 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852869/ [6852870] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:17:48 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852870/ [6852871] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:31:19 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852871/ [6852872] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} time: 00:55:30 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852872/ [6852873] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:04 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852873/ [6852874] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/fsx} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852874/ [6852876] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:31:16 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852876/ [6852877] rbd/singleton/{all/mon-command-help objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852877/ [6852878] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} time: 02:12:20 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852878/ [6852879] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852879/ [6852880] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852880/ [6852881] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} time: 00:57:24 info: http://pulpito.ceph.com/teuthology-2022-05-30_02:01:03-rbd-quincy-distro-default-smithi/6852881/