2022-04-05T00:51:21.002 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-05T00:51:21.003 INFO:teuthology.results:subset: '4497/100000' 2022-04-05T00:51:21.004 INFO:teuthology.results:seed: '5876' 2022-04-05T03:27:38.656 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-05T03:27:38.687 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-05T10:05:10.252 INFO:teuthology.results:Tests finished! gathering results... 2022-04-05T10:05:23.181 INFO:scrape:Found 179 jobs 2022-04-05T10:05:36.109 INFO:scrape:Found 11 distinct failure reasons 2022-04-05T10:05:36.111 INFO:scrape:Failure: Command failed on smithi156 with status 127: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'qemu-img create -f qcow2 /home/ubuntu/cephtest/migration/empty.qcow2 1G'" 2022-04-05T10:05:36.111 INFO:scrape:2 jobs: ['6775884', '6775829'] 2022-04-05T10:05:36.111 INFO:scrape:suites intersection: ['2-clusters/{fixed-3', '4-supported-random-distro$/{centos_8}', '5-pool/ec-data-pool', '6-prepare/qcow2-file', '7-io-workloads/qemu_xfstests', '8-migrate-workloads/execute', '9-cleanup/cleanup}', 'openstack}', 'rbd/migration/{1-base/install'] 2022-04-05T10:05:36.112 INFO:scrape:suites union: ['2-clusters/{fixed-3', '3-objectstore/bluestore-comp-zstd', '3-objectstore/bluestore-stupid', '4-supported-random-distro$/{centos_8}', '5-pool/ec-data-pool', '6-prepare/qcow2-file', '7-io-workloads/qemu_xfstests', '8-migrate-workloads/execute', '9-cleanup/cleanup}', 'openstack}', 'rbd/migration/{1-base/install'] 2022-04-05T10:05:36.113 INFO:scrape: 2022-04-05T10:05:36.113 INFO:scrape:Failure: Command failed on smithi195 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" 2022-04-05T10:05:36.113 INFO:scrape:46 jobs 2022-04-05T10:05:36.114 INFO:scrape:suites intersection: [] 2022-04-05T10:05:36.115 INFO:scrape:suites union: ['cachepool/none', 'cachepool/small', 'centos_latest', 'clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'clusters/{fixed-2', 'clusters/{fixed-3', 'config/permit-partial-discard', 'features/format-1', 'features/journaling', 'features/layering', 'min-compat-client/default', 'min-compat-client/octopus', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/none', 'policy/simple', 'pool/ec-data-pool', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'qemu/xfstests', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'rbd/librbd/{cache/writearound', 'rbd/librbd/{cache/writeback', 'rbd/maintenance/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'rbd/nbd/{base/install', 'rbd/singleton-bluestore/{all/issue-20295', 'rbd/singleton/{all/admin_socket', 'rbd/singleton/{all/qemu-iotests-no-cache', 'rbd/singleton/{all/qemu-iotests-writearound', 'rbd/singleton/{all/read-flags-no-cache', 'rbd/singleton/{all/verify_pool', 'rbd/thrash/{base/install', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_cls_tests}', 'tasks/rbd_lock_and_fence}', 'thrashers/default', 'thrashosds-health', 'validator/memcheck', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}', 'workloads/dynamic_features}', 'workloads/journal}', 'workloads/python_api_tests_with_defaults}', 'workloads/python_api_tests_with_journaling}', 'workloads/python_api_tests}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-journal-stress-workunit}', 'workloads/rbd-mirror-journal-workunit}', 'workloads/rbd-mirror-snapshot-bootstrap-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}', 'workloads/rbd-mirror-workunit-min-compat-client-octopus}', 'workloads/rbd_api_tests_no_locking}', 'workloads/rbd_cli_generic}', 'workloads/rbd_cli_groups}', 'workloads/rbd_cli_import_export}', 'workloads/rbd_cli_migration}', 'workloads/rbd_mirror}', 'workloads/rbd_nbd}', 'workloads/rebuild_object_map}'] 2022-04-05T10:05:36.115 INFO:scrape: 2022-04-05T10:05:36.116 INFO:scrape:Failure: Command failed on smithi099 with status 127: 'genisoimage -quiet -input-charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user-data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta-data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' 2022-04-05T10:05:36.116 INFO:scrape:7 jobs: ['6775711', '6775840', '6775779', '6775828', '6775773', '6775755', '6775857'] 2022-04-05T10:05:36.117 INFO:scrape:suites intersection: ['openstack}', 'supported-random-distro$/{centos_8}'] 2022-04-05T10:05:36.117 INFO:scrape:suites union: ['clusters/{fixed-3', 'features/defaults', 'features/journaling', 'features/readbalance', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'pool/ceph_and_immutable_object_cache', 'pool/ec-cache-pool', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'rbd/encryption/{cache/none', 'rbd/encryption/{cache/writethrough', 'rbd/immutable-object-cache/{clusters/{fix-2', 'rbd/qemu/{cache/none', 'rbd/qemu/{cache/writearound', 'supported-random-distro$/{centos_8}', 'workloads/qemu_bonnie}', 'workloads/qemu_fsstress}', 'workloads/qemu_on_immutable_object_cache_and_thrash}', 'workloads/qemu_xfstests_luks1}', 'workloads/qemu_xfstests_luks2}', 'workloads/qemu_xfstests}'] 2022-04-05T10:05:36.117 INFO:scrape: 2022-04-05T10:05:36.118 INFO:scrape:Dead: b'2022-04-05T07:57:13.093 DEBUG:teuthology.exit:Finished running handlers' 2022-04-05T10:05:36.118 INFO:scrape:2 jobs: ['6775754', '6775887'] 2022-04-05T10:05:36.119 INFO:scrape:suites intersection: ['openstack}'] 2022-04-05T10:05:36.119 INFO:scrape:suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{rhel_8}', '4-pool/big-cache', '5-cache-mode/rwl', '6-workloads/qemu_xfstests}', 'clusters/{fixed-1', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/persistent-writeback-cache/{1-base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_migration}'] 2022-04-05T10:05:36.120 INFO:scrape: 2022-04-05T10:05:36.120 INFO:scrape:Failure: "2022-04-05T01:42:09.845729+0000 mon.a (mon.0) 231 : cluster [WRN] Health check failed: Degraded data redundancy: 1/774 objects degraded (0.129%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-04-05T10:05:36.120 INFO:scrape:2 jobs: ['6775759', '6775813'] 2022-04-05T10:05:36.121 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'supported-random-distro$/{ubuntu_latest}'] 2022-04-05T10:05:36.121 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff}'] 2022-04-05T10:05:36.121 INFO:scrape: 2022-04-05T10:05:36.122 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2022-04-05T10:05:36.122 INFO:scrape:1 jobs: ['6775731'] 2022-04-05T10:05:36.123 INFO:scrape:suites: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd_cli_generic}'] 2022-04-05T10:05:36.123 INFO:scrape: 2022-04-05T10:05:36.124 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2022-04-05T10:05:36.124 INFO:scrape:2 jobs: ['6775756', '6775798'] 2022-04-05T10:05:36.124 INFO:scrape:suites intersection: ['clusters/{fixed-3', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2022-04-05T10:05:36.125 INFO:scrape:suites union: ['clusters/{fixed-3', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}'] 2022-04-05T10:05:36.125 INFO:scrape: 2022-04-05T10:05:36.126 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-04-05T10:05:36.126 INFO:scrape:2 jobs: ['6775732', '6775817'] 2022-04-05T10:05:36.126 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}'] 2022-04-05T10:05:36.127 INFO:scrape:suites union: ['cluster/{fixed-3', 'clusters/{fixed-3', 'features/readbalance', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'openstack}', 'pool/ec-data-pool', 'rbd/nbd/{base/install', 'rbd/qemu/{cache/writethrough', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/qemu_fsstress}', 'workloads/rbd_fsx_nbd}'] 2022-04-05T10:05:36.127 INFO:scrape: 2022-04-05T10:05:36.128 INFO:scrape:Failure: Command failed on smithi087 with status 2: 'cd /home/ubuntu/cephtest/rbd_fio_test ; wget https://github.com/axboe/fio/archive/fio-3.16.tar.gz ; tar -xvf fio*tar.gz ; cd fio-fio* ; ./configure ; make' 2022-04-05T10:05:36.128 INFO:scrape:3 jobs: ['6775715', '6775742', '6775886'] 2022-04-05T10:05:36.128 INFO:scrape:suites intersection: ['openstack}', 'supported-random-distro$/{centos_8}'] 2022-04-05T10:05:36.129 INFO:scrape:suites union: ['clusters/{fixed-3', 'config/copy-on-read', 'config/permit-partial-discard', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'pool/ceph_and_immutable_object_cache', 'pool/ec-data-pool', 'pool/none', 'rbd/immutable-object-cache/{clusters/{fix-2', 'rbd/librbd/{cache/none', 'supported-random-distro$/{centos_8}', 'workloads/fio_on_immutable_object_cache}', 'workloads/rbd_fio}'] 2022-04-05T10:05:36.129 INFO:scrape: 2022-04-05T10:05:36.130 INFO:scrape:Failure: "2022-04-05T02:29:06.175784+0000 osd.0 (osd.0) 3 : cluster [WRN] 1 slow requests (by type [ 'delayed' : 1 ] most affected pool [ 'cache' : 1 ])" in cluster log 2022-04-05T10:05:36.130 INFO:scrape:1 jobs: ['6775801'] 2022-04-05T10:05:36.131 INFO:scrape:suites: ['clusters/{fixed-3', 'features/journaling', 'msgr-failures/few', 'objectstore/filestore-xfs', 'openstack}', 'pool/ec-cache-pool', 'rbd/qemu/{cache/writeback', 'supported-random-distro$/{rhel_8}', 'workloads/qemu_bonnie}'] 2022-04-05T10:05:36.131 INFO:scrape: 2022-04-05T10:05:36.131 INFO:scrape:Failure: Command failed on smithi097 with status 127: "cd /home/ubuntu/cephtest && adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/fsx_client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 134217728 -S 0 -N 1000 pool_client.0 image_client.0" 2022-04-05T10:05:36.132 INFO:scrape:1 jobs: ['6775753'] 2022-04-05T10:05:36.132 INFO:scrape:suites: ['centos_latest', 'clusters/{fixed-1', 'objectstore/bluestore-bitmap', 'openstack}', 'rbd/valgrind/{base/install', 'validator/memcheck', 'workloads/fsx}'] 2022-04-05T10:05:36.133 INFO:scrape: 2022-04-05T10:05:36.139 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/ failed: 67 dead: 2 running: 0 waiting: 0 queued: 0 passed: 110 Fail ================================================================= [6775711] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775711/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775711/ sentry: https://sentry.ceph.com/organizations/ceph/?query=864090794e394bdfaf36ed33eff191e1 Command failed on smithi099 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775712] rbd/singleton/{all/read-flags-no-cache objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775712/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e299fe419c3e4044955ca3f1967ef27d Command failed on smithi022 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775713] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775713/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775713/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48189bd3755f4b6f8534313c42dbe641 Command failed on smithi085 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775715] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/fio_on_immutable_object_cache} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775715/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775715/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f75c59795504116921c02fb8141cd81 Command failed on smithi087 with status 2: 'cd /home/ubuntu/cephtest/rbd_fio_test ; wget https://github.com/axboe/fio/archive/fio-3.16.tar.gz ; tar -xvf fio*tar.gz ; cd fio-fio* ; ./configure ; make' [6775718] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775718/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775718/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eef1254383d6420c9e778d13a30e5b2f Command failed on smithi105 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775719] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775719/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775719/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6fc7858e3ea045988b2cd646777eeb4b Command failed on smithi143 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775720] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775720/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775720/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1a3c4c2e9d65417380863c18016879f6 Command failed on smithi153 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775728] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:07:46 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775728/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775728/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f31f065761ba4d599a19a40d5ec669f6 Command failed on smithi187 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775731] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:26:10 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775731/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775731/ sentry: https://sentry.ceph.com/organizations/ceph/?query=600ebec528d6416e887b60a75459e7eb Command failed (workunit test rbd/cli_generic.sh) on smithi085 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=17cbe246c31633a51b6c187a5b1d618da2623f96 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6775732] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775732/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775732/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c6122d4447b459ca753a733b6e4c4a1 reached maximum tries (90) after waiting for 540 seconds [6775736] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775736/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775736/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c072beb76a7144b0a13ccd1c450d1ac6 Command failed on smithi169 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775741] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775741/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775741/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b6a8d71363c4905b3a8209c626fc7cd Command failed on smithi166 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775742] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{centos_8} workloads/rbd_fio} ----------------------------------------------------------------- time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775742/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775742/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ec8a15476be4ca791db887b1c2dc51d Command failed on smithi157 with status 2: 'cd /home/ubuntu/cephtest/rbd_fio_test ; wget https://github.com/axboe/fio/archive/fio-3.16.tar.gz ; tar -xvf fio*tar.gz ; cd fio-fio* ; ./configure ; make' [6775743] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775743/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775743/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5398ccf260244cf2b1b623b70ee05336 Command failed on smithi153 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775746] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:07:06 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775746/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=050409d7bc1c49e3917e8c44e370ad0e Command failed on smithi049 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775750] rbd/singleton/{all/verify_pool objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775750/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775750/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9aaa07d2f9584b4b9824ab5e06b2d830 Command failed on smithi025 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775753] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/fsx} ----------------------------------------------------------------- time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775753/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=edfdc77a998a4c10bd73976d814b81b6 Command failed on smithi097 with status 127: "cd /home/ubuntu/cephtest && adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child- silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num- callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/fsx_client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 134217728 -S 0 -N 1000 pool_client.0 image_client.0" [6775755] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775755/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d479b8fc833422e981c0e4cd7214c14 Command failed on smithi137 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775756] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 03:12:38 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775756/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775756/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a49b447debc347b8b7f02cd834b05c18 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi166 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=17cbe246c31633a51b6c187a5b1d618da2623f96 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' [6775759] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:33:59 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775759/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775759/ "2022-04-05T01:42:09.845729+0000 mon.a (mon.0) 231 : cluster [WRN] Health check failed: Degraded data redundancy: 1/774 objects degraded (0.129%), 1 pg degraded (PG_DEGRADED)" in cluster log [6775760] rbd/singleton/{all/admin_socket objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775760/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c062398f6164141bc231618d331916e Command failed on smithi055 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775761] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} ----------------------------------------------------------------- time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775761/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775761/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97e62a0c65a6449087642570d5c599bc Command failed on smithi087 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775768] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775768/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775768/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1eabaee69bc5422eae8db4408be204a2 Command failed on smithi174 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775770] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775770/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac17fb135ac5404d8a9f7df29aaac5ec Command failed on smithi045 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775771] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/python_api_tests} ----------------------------------------------------------------- time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775771/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76f2807aa46449faa696d8d102f29780 Command failed on smithi135 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775773] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775773/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775773/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f66d434909e34b1ca418072a11bb16ac Command failed on smithi137 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775774] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775774/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c57f971a325b4dfaa87dd1a20d9d14e3 Command failed on smithi139 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775777] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775777/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775777/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4454fddb58db4077b818d1202b6f9f50 Command failed on smithi026 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775779] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/qemu_on_immutable_object_cache_and_thrash} ----------------------------------------------------------------- time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775779/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775779/ sentry: https://sentry.ceph.com/organizations/ceph/?query=567752c26f9247ca9ab3a8d80ad7a055 Command failed on smithi078 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775780] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775780/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775780/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4a7af635f5542209d0840d4914733c9 Command failed on smithi099 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775783] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775783/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8b746e82de44910ad1b58c4dab8e8bf Command failed on smithi195 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775784] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} ----------------------------------------------------------------- time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775784/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775784/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76270a69aa36429586a083eec9cd2566 Command failed on smithi173 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775788] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775788/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775788/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b376ec18f29746a7b2aac42fb911535e Command failed on smithi104 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775789] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775789/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775789/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aaf2ac24091c482cb9ccdeb75f65376e Command failed on smithi174 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775793] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775793/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775793/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c3bb16ea09649f683b46fbf35a53a38 Command failed on smithi026 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775798] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 03:12:14 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775798/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775798/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55c495852e844be29da5fcc6a183f021 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi154 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=17cbe246c31633a51b6c187a5b1d618da2623f96 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' [6775799] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775799/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775799/ sentry: https://sentry.ceph.com/organizations/ceph/?query=faf856fa85884af8b29027cc1893f51d Command failed on smithi190 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775800] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775800/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775800/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33a72a9252924591bad9d351ac3afafc Command failed on smithi036 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775801] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:32:05 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775801/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775801/ "2022-04-05T02:29:06.175784+0000 osd.0 (osd.0) 3 : cluster [WRN] 1 slow requests (by type [ 'delayed' : 1 ] most affected pool [ 'cache' : 1 ])" in cluster log [6775802] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775802/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775802/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aba817ba71c84e72a1a2125b1378b814 Command failed on smithi033 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775805] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775805/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775805/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0c78558084e46268bb6f28a59ca2d8b Command failed on smithi077 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775806] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} ----------------------------------------------------------------- time: 00:07:45 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775806/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775806/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c30a8392e48426099a8debd71b8e097 Command failed on smithi087 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775808] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775808/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775808/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0171587425224c418217b88ff76f3824 Command failed on smithi173 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775813] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} ----------------------------------------------------------------- time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775813/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775813/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1eb586b5f0bd4a5bbcc32acd79c73034 "2022-04-05T02:18:54.032863+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6775817] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:27:16 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775817/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775817/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45b74887b41a4b96a0c5e6b3f7cfe6df reached maximum tries (90) after waiting for 540 seconds [6775822] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} ----------------------------------------------------------------- time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775822/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775822/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5ba49b431ae41bda20bb2e7959235a6 Command failed on smithi189 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775828] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775828/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775828/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48597f0124e148138b9cb931ffbe348d Command failed on smithi083 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775829] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775829/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e64f32976f1d4e22af85c34e510c6472 Command failed on smithi137 with status 127: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'qemu-img create -f qcow2 /home/ubuntu/cephtest/migration/empty.qcow2 1G'" [6775831] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/python_api_tests} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775831/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775831/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de200e3f74614d85ad153223e68dbad3 Command failed on smithi201 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775834] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775834/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775834/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c822be7ab3124f07b9128e05e0ca0fd5 Command failed on smithi116 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775837] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775837/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775837/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56e9a04ab5074834ae0ddc0ea0a46ecf Command failed on smithi078 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775839] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775839/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775839/ sentry: https://sentry.ceph.com/organizations/ceph/?query=948213c53e3c44bfb1d042bc31471979 Command failed on smithi008 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775840] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775840/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775840/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2b447f1c4744cbd9788a03901fce1d5 Command failed on smithi137 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775843] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/c_api_tests} ----------------------------------------------------------------- time: 00:16:19 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775843/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cdbd82e6e25042c280dc4b3d479dacb1 Command failed on smithi145 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775846] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_migration} ----------------------------------------------------------------- time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775846/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775846/ sentry: https://sentry.ceph.com/organizations/ceph/?query=640fea302a2144ce964290f6e6eef423 Command failed on smithi201 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775857] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775857/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775857/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a52326328964815a9f809e7b3a38b9b Command failed on smithi201 with status 127: 'genisoimage -quiet -input- charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user- data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta- data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh' [6775858] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775858/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775858/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab8237556cca402fb9d78065d47a1f70 Command failed on smithi195 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775860] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775860/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775860/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afc563e2031242fca9c2e67aa802a7e3 Command failed on smithi008 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775861] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775861/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775861/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46ea2fd919ec44d0a9dfa2e562c0a305 Command failed on smithi016 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775867] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775867/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5c5a09e1212492fb10f14e55ef508af Command failed on smithi104 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775875] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775875/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775875/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c24bb1d87f5435aab2f449844dcb0cc Command failed on smithi160 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775876] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775876/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b9fa4ee0a5c41089b544c1990adc9ad Command failed on smithi141 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775877] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775877/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775877/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51f9d105fd1e4a23ab773761d30effff Command failed on smithi178 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775878] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775878/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775878/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6c58e1c688544b5a374f8581a589fbc Command failed on smithi104 with status 2: "cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror" [6775880] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775880/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8135b5e92fda4ed8b5302d6ce3ec1711 Command failed on smithi105 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6775884] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 00:07:19 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775884/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775884/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0bf4708be297469f9806a0a0191baba8 Command failed on smithi156 with status 127: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'qemu-img create -f qcow2 /home/ubuntu/cephtest/migration/empty.qcow2 1G'" [6775886] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_fio} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775886/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775886/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f174b503ea34250bdea59a0c928d526 Command failed on smithi186 with status 2: 'cd /home/ubuntu/cephtest/rbd_fio_test ; wget https://github.com/axboe/fio/archive/fio-3.16.tar.gz ; tar -xvf fio*tar.gz ; cd fio-fio* ; ./configure ; make' Dead ================================================================= [6775754] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775754/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775754/ hit max job timeout [6775887] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775887/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775887/ hit max job timeout Pass ================================================================= [6775710] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775710/ [6775714] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775714/ [6775716] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:23:24 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775716/ [6775717] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:37 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775717/ [6775721] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 01:13:41 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775721/ [6775722] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/fio} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775722/ [6775723] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775723/ [6775724] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:16:45 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775724/ [6775725] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775725/ [6775726] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:00:22 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775726/ [6775727] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775727/ [6775729] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} time: 00:31:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775729/ [6775730] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} time: 01:48:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775730/ [6775733] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:05:29 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775733/ [6775734] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775734/ [6775735] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775735/ [6775737] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775737/ [6775738] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 01:18:59 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775738/ [6775739] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:02:41 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775739/ [6775740] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775740/ [6775744] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775744/ [6775745] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775745/ [6775747] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775747/ [6775748] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:31:32 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775748/ [6775749] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775749/ [6775751] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775751/ [6775752] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/qemu_xfstests} time: 01:39:14 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775752/ [6775757] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:22:20 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775757/ [6775758] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-ha-workunit} time: 00:25:08 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775758/ [6775762] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/c_api_tests} time: 00:33:21 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775762/ [6775763] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775763/ [6775764] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775764/ [6775765] rbd/singleton/{all/formatted-output objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775765/ [6775766] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775766/ [6775767] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests} time: 00:27:45 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775767/ [6775769] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775769/ [6775772] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775772/ [6775775] rbd/singleton/{all/merge_diff objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775775/ [6775776] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:45:30 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775776/ [6775778] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775778/ [6775781] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775781/ [6775782] rbd/singleton/{all/mon-command-help objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:05:25 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775782/ [6775785] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} time: 01:43:59 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775785/ [6775786] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/recovery} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775786/ [6775787] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775787/ [6775790] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} time: 00:05:34 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775790/ [6775791] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 02:15:30 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775791/ [6775792] rbd/singleton/{all/permissions objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775792/ [6775794] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775794/ [6775795] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:28:29 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775795/ [6775796] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775796/ [6775797] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling} time: 00:40:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775797/ [6775803] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775803/ [6775804] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775804/ [6775807] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:44:38 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775807/ [6775809] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:06:01 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775809/ [6775810] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 01:50:00 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775810/ [6775811] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 01:44:30 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775811/ [6775812] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:28:08 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775812/ [6775814] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/fsx} time: 00:29:48 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775814/ [6775815] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775815/ [6775816] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775816/ [6775818] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775818/ [6775819] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775819/ [6775820] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/c_api_tests_with_defaults} time: 00:43:39 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775820/ [6775821] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} time: 00:16:57 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775821/ [6775823] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 01:38:36 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775823/ [6775824] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775824/ [6775825] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:49 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775825/ [6775826] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775826/ [6775827] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775827/ [6775830] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775830/ [6775832] rbd/singleton/{all/qos objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775832/ [6775833] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775833/ [6775835] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} time: 00:33:23 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775835/ [6775836] rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:52:44 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775836/ [6775838] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:30:00 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775838/ [6775841] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:57:53 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775841/ [6775842] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775842/ [6775844] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775844/ [6775845] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775845/ [6775847] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 03:22:24 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775847/ [6775848] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:06:57 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775848/ [6775849] rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} time: 00:39:59 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775849/ [6775850] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_defaults} time: 00:28:42 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775850/ [6775851] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:13:29 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775851/ [6775852] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 01:01:31 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775852/ [6775853] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775853/ [6775854] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775854/ [6775855] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio} time: 00:36:06 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775855/ [6775856] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775856/ [6775859] rbd/singleton/{all/rbd_tasks objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775859/ [6775862] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775862/ [6775863] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 01:30:09 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775863/ [6775864] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 01:24:33 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775864/ [6775865] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:34:25 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775865/ [6775866] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} time: 00:31:17 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775866/ [6775868] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775868/ [6775869] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:04:38 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775869/ [6775870] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775870/ [6775871] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775871/ [6775872] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:05:04 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775872/ [6775873] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775873/ [6775874] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775874/ [6775879] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_journal} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775879/ [6775881] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 01:37:08 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775881/ [6775882] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:19:01 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775882/ [6775883] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775883/ [6775885] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775885/ [6775888] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:00:46 info: http://pulpito.ceph.com/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775888/