2021-12-06T02:58:10.363 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-06T02:58:10.364 INFO:teuthology.results:subset: '11812/100000' 2021-12-06T02:58:10.364 INFO:teuthology.results:seed: '8111' 2021-12-06T08:17:44.651 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-06T08:17:44.683 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-12-06T11:28:58.753 INFO:teuthology.results:Tests finished! gathering results... 2021-12-06T11:29:11.968 INFO:scrape:Found 178 jobs 2021-12-06T11:29:12.140 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547058/teuthology.log 2021-12-06T11:29:15.475 INFO:scrape:Found 8 distinct failure reasons 2021-12-06T11:29:15.476 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2021-12-06T11:29:15.476 INFO:scrape:3 jobs: ['6547068', '6547144', '6547095'] 2021-12-06T11:29:15.477 INFO:scrape:suites intersection: ['msgr-failures/few', 'openstack}'] 2021-12-06T11:29:15.477 INFO:scrape:suites union: ['clusters/{fixed-2', 'clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'pool/ec-cache-pool', 'rbd/encryption/{cache/none', 'rbd/thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/qemu_xfstests_luks2}', 'workloads/rbd_fsx_copy_on_read}', 'workloads/rbd_fsx_rate_limit}'] 2021-12-06T11:29:15.478 INFO:scrape: 2021-12-06T11:29:15.478 INFO:scrape:Dead: None 2021-12-06T11:29:15.479 INFO:scrape:22 jobs: ['6547058', '6547139', '6547201', '6547156', '6547127', '6547165', '6547054', '6547083', '6547115', '6547079', '6547075', '6547062', '6547122', '6547188', '6547105', '6547208', '6547170', '6547100', '6547216', '6547176', '6547094', '6547148'] 2021-12-06T11:29:15.479 INFO:scrape: 2021-12-06T11:29:15.480 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_bootstrap.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=journal MIRROR_POOL_MODE=pool RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_bootstrap.sh' 2021-12-06T11:29:15.480 INFO:scrape:1 jobs: ['6547168'] 2021-12-06T11:29:15.481 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-journal-bootstrap-workunit}'] 2021-12-06T11:29:15.481 INFO:scrape: 2021-12-06T11:29:15.481 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi017 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=125 VALGRIND=\'--tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 2021-12-06T11:29:15.482 INFO:scrape:3 jobs: ['6547072', '6547171', '6547205'] 2021-12-06T11:29:15.482 INFO:scrape:suites intersection: ['centos_latest', 'clusters/{fixed-1', 'openstack}', 'rbd/valgrind/{base/install', 'validator/memcheck'] 2021-12-06T11:29:15.483 INFO:scrape:suites union: ['centos_latest', 'clusters/{fixed-1', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rbd/valgrind/{base/install', 'validator/memcheck', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}'] 2021-12-06T11:29:15.483 INFO:scrape: 2021-12-06T11:29:15.484 INFO:scrape:Failure: "2021-12-06T04:40:01.352835+0000 mon.a (mon.0) 104 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2021-12-06T11:29:15.484 INFO:scrape:6 jobs: ['6547131', '6547202', '6547150', '6547134', '6547101', '6547193'] 2021-12-06T11:29:15.484 INFO:scrape:suites intersection: ['openstack}'] 2021-12-06T11:29:15.485 INFO:scrape:suites union: ['cachepool/small', 'clients/mirror', 'cluster/{2-node', 'clusters/{fixed-1', 'clusters/{fixed-3', 'config/none', 'features/defaults', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'policy/simple', 'pool/none', 'qemu/xfstests', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/encryption/{cache/writethrough', 'rbd/librbd/{cache/writearound', 'rbd/maintenance/{base/install', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rbd_lock_and_fence}', 'workloads/c_api_tests_with_journaling}', 'workloads/dynamic_features_no_cache}', 'workloads/qemu_xfstests_luks1}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}'] 2021-12-06T11:29:15.485 INFO:scrape: 2021-12-06T11:29:15.486 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2021-12-06T11:29:15.486 INFO:scrape:1 jobs: ['6547218'] 2021-12-06T11:29:15.487 INFO:scrape:suites: ['clusters/{fixed-3', 'objectstore/filestore-xfs', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{centos_8.stream}', 'workloads/dynamic_features}'] 2021-12-06T11:29:15.487 INFO:scrape: 2021-12-06T11:29:15.488 INFO:scrape:Failure: Command failed on smithi116 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ac826d1665a2548d2bd18edc4c35a172f7159101 -v bootstrap --fsid dbb099a2-5643-11ec-8c2e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.116 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-12-06T11:29:15.488 INFO:scrape:1 jobs: ['6547056'] 2021-12-06T11:29:15.488 INFO:scrape:suites: ['cluster/{fixed-3', 'openstack}', 'rbd/iscsi/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/cephadm_iscsi}'] 2021-12-06T11:29:15.489 INFO:scrape: 2021-12-06T11:29:15.489 INFO:scrape:Failure: Command failed on smithi122 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2021-12-06T11:29:15.490 INFO:scrape:2 jobs: ['6547124', '6547177'] 2021-12-06T11:29:15.490 INFO:scrape:suites intersection: ['openstack}'] 2021-12-06T11:29:15.491 INFO:scrape:suites union: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/ceph_and_immutable_object_cache', 'pool/replicated-data-pool', 'rbd/encryption/{cache/writethrough', 'rbd/immutable-object-cache/{clusters/{fix-2', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/qemu_on_immutable_object_cache_and_thrash}', 'workloads/qemu_xfstests_luks1}'] 2021-12-06T11:29:15.491 INFO:scrape: 2021-12-06T11:29:15.496 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/ failed: 17 dead: 22 running: 0 waiting: 0 queued: 0 passed: 139 Fail ================================================================= [6547056] rbd/iscsi/{base/install cluster/{fixed-3 openstack} supported-random-distro$/{rhel_8} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547056/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547056/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf6084c67a724f38ba9ed2be498f18a5 Command failed on smithi116 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:ac826d1665a2548d2bd18edc4c35a172f7159101 -v bootstrap --fsid dbb099a2-5643-11ec-8c2e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.116 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [6547068] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:16:54 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547068/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=649f529d1ba64c7ebabf2171dd52a026 reached maximum tries (90) after waiting for 540 seconds [6547072] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 01:01:27 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6c2d65a45ec428baa819b4c08ede8f4 Command failed (workunit test rbd/test_librbd.sh) on smithi017 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=125 VALGRIND=\'-- tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6547095] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} ----------------------------------------------------------------- time: 00:30:02 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547095/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe60db10ffe9483db69641ec2af74366 reached maximum tries (90) after waiting for 540 seconds [6547101] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547101/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547101/ "2021-12-06T04:17:45.754379+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547124] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547124/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547124/ Command failed on smithi122 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [6547131] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547131/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547131/ sentry: https://sentry.ceph.com/organizations/ceph/?query=390e9601929c4a3ea2adf16e276ac69a "2021-12-06T04:40:01.352835+0000 mon.a (mon.0) 104 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547134] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:44:24 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547134/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547134/ "2021-12-06T05:08:10.148393+0000 mon.a (mon.0) 802 : cluster [WRN] Health check failed: Degraded data redundancy: 1/618 objects degraded (0.162%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547144] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} ----------------------------------------------------------------- time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547144/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e30e455b0984a1986cb8b1c7aea6873 reached maximum tries (90) after waiting for 540 seconds [6547150] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:39:06 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547150/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547150/ "2021-12-06T04:58:46.674458+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: Degraded data redundancy: 4/2018 objects degraded (0.198%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547168] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} ----------------------------------------------------------------- time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547168/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547168/ sentry: https://sentry.ceph.com/organizations/ceph/?query=291a30212179474ab792a87f2c19c626 Command failed (workunit test rbd/rbd_mirror_bootstrap.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=journal MIRROR_POOL_MODE=pool RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_bootstrap.sh' [6547171] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests} ----------------------------------------------------------------- time: 00:43:20 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3ccdca2877244969580698494bd1ffe Command failed (workunit test rbd/test_librbd.sh) on smithi180 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=1 VALGRIND=\'-- tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6547177] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/qemu_on_immutable_object_cache_and_thrash} ----------------------------------------------------------------- time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547177/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547177/ Command failed on smithi187 with status 1: 'test -n "$(ls /tmp/ceph- immutable-object-cache )"' [6547193] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547193/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547193/ "2021-12-06T05:35:54.241308+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547202] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:28:48 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547202/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547202/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44502899539540268ee7351cde9e4ad0 "2021-12-06T05:47:06.514220+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6547205] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:56:29 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547205/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e27e589b331f4845bca1cc16262095e0 Command failed (workunit test rbd/test_librbd.sh) on smithi045 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=125 VALGRIND=\'-- tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6547218] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features} ----------------------------------------------------------------- time: 03:07:50 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547218/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b30cedc589c44829737763ebb58b482 Command failed (workunit test rbd/qemu_dynamic_features.sh) on smithi122 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac826d1665a2548d2bd18edc4c35a172f7159101 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IMAGE_NAME=client.0.1-clone adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /ho me/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh ' Dead ================================================================= [6547054] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547054/ Error reimaging machines: Failed to power on smithi199 [6547058] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547058/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547058/ Error reimaging machines: Failed to power on smithi199 [6547062] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547062/ Error reimaging machines: Failed to power on smithi199 [6547075] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547075/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547075/ Error reimaging machines: Failed to power on smithi199 [6547079] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8.stream} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547079/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547079/ Error reimaging machines: Failed to power on smithi199 [6547083] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547083/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547083/ Error reimaging machines: Failed to power on smithi199 [6547094] rbd/singleton/{all/rbd_tasks objectstore/filestore-xfs openstack supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547094/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547094/ Error reimaging machines: Failed to power on smithi199 [6547100] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547100/ Error reimaging machines: Failed to power on smithi199 [6547105] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547105/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547105/ Error reimaging machines: Failed to power on smithi199 [6547115] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547115/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547115/ Error reimaging machines: Failed to power on smithi199 [6547122] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547122/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547122/ Error reimaging machines: Failed to power on smithi199 [6547127] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547127/ Error reimaging machines: Failed to power on smithi199 [6547139] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547139/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547139/ Error reimaging machines: Failed to power on smithi199 [6547148] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547148/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547148/ Error reimaging machines: Failed to power on smithi199 [6547156] rbd/singleton/{all/admin_socket objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547156/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547156/ Error reimaging machines: Failed to power on smithi199 [6547165] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547165/ Error reimaging machines: Failed to power on smithi199 [6547170] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547170/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547170/ Error reimaging machines: Failed to power on smithi199 [6547176] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547176/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547176/ Error reimaging machines: Failed to power on smithi199 [6547188] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547188/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547188/ Error reimaging machines: Failed to power on smithi199 [6547201] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests_no_locking} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547201/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547201/ Error reimaging machines: Failed to power on smithi199 [6547208] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{centos_8.stream} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547208/ Error reimaging machines: Failed to power on smithi199 [6547216] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547216/ Error reimaging machines: Failed to power on smithi199 Pass ================================================================= [6547049] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547049/ [6547050] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547050/ [6547051] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:09:09 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547051/ [6547052] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547052/ [6547053] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547053/ [6547055] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547055/ [6547057] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547057/ [6547059] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547059/ [6547060] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547060/ [6547061] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547061/ [6547063] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547063/ [6547064] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8.stream} workloads/python_api_tests_with_journaling} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547064/ [6547065] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547065/ [6547066] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-journal-workunit} time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547066/ [6547067] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:33:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547067/ [6547069] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547069/ [6547070] rbd/singleton/{all/qos objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8.stream}} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547070/ [6547071] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547071/ [6547073] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:24:57 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547073/ [6547074] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547074/ [6547076] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/rebuild_object_map} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547076/ [6547077] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547077/ [6547078] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547078/ [6547080] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547080/ [6547081] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 01:00:37 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547081/ [6547082] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_fio} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547082/ [6547084] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8.stream} workloads/rbd_cli_groups} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547084/ [6547085] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547085/ [6547086] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547086/ [6547087] rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:41:31 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547087/ [6547088] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8.stream} tasks/rbd_python_api_tests_old_format} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547088/ [6547089] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/fsx} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547089/ [6547090] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:21:08 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547090/ [6547091] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547091/ [6547092] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547092/ [6547093] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:53:32 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547093/ [6547096] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:52:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547096/ [6547097] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/c_api_tests} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547097/ [6547098] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547098/ [6547099] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547099/ [6547102] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547102/ [6547103] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547103/ [6547104] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:05:50 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547104/ [6547106] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:32:21 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547106/ [6547107] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547107/ [6547108] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests} time: 00:31:10 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547108/ [6547109] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547109/ [6547110] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547110/ [6547111] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/recovery} time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547111/ [6547112] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} time: 00:36:09 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547112/ [6547113] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features_no_cache} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547113/ [6547114] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547114/ [6547116] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547116/ [6547117] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547117/ [6547118] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{centos_8.stream} workloads/c_api_tests_with_defaults} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547118/ [6547119] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_journal} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547119/ [6547120] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547120/ [6547121] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547121/ [6547123] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} time: 00:21:24 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547123/ [6547125] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547125/ [6547126] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/python_api_tests_with_defaults} time: 00:33:06 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547126/ [6547128] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:21:50 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547128/ [6547129] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8.stream}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547129/ [6547130] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nocache} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547130/ [6547132] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:34:17 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547132/ [6547133] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547133/ [6547135] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:42:08 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547135/ [6547136] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{centos_8.stream} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547136/ [6547137] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547137/ [6547138] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} time: 00:46:58 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547138/ [6547140] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} time: 00:22:02 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547140/ [6547141] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/python_api_tests_with_journaling} time: 00:34:52 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547141/ [6547142] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547142/ [6547143] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547143/ [6547145] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:30:15 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547145/ [6547146] rbd/singleton/{all/verify_pool objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} time: 00:20:09 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547146/ [6547147] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547147/ [6547149] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/ssd 6-workloads/c_api_tests_with_defaults} time: 00:26:58 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547149/ [6547151] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/fsx} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547151/ [6547152] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{centos_8.stream} workloads/qemu_fsstress} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547152/ [6547153] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547153/ [6547154] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547154/ [6547155] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-ha-workunit} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547155/ [6547157] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/journal} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547157/ [6547158] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:31:16 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547158/ [6547159] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} time: 00:53:02 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547159/ [6547160] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547160/ [6547161] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547161/ [6547162] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547162/ [6547163] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:39:40 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547163/ [6547164] rbd/singleton/{all/formatted-output objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547164/ [6547166] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests} time: 00:43:04 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547166/ [6547167] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547167/ [6547169] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547169/ [6547172] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547172/ [6547173] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547173/ [6547174] rbd/singleton/{all/merge_diff objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547174/ [6547175] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/rbd_cli_groups} time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547175/ [6547178] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547178/ [6547179] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547179/ [6547180] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547180/ [6547181] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8.stream} 4-pool/cache 5-cache-mode/rwl 6-workloads/fio} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547181/ [6547182] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547182/ [6547183] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547183/ [6547184] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:32:58 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547184/ [6547185] rbd/singleton/{all/permissions objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547185/ [6547186] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} time: 00:21:24 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547186/ [6547187] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547187/ [6547189] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547189/ [6547190] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:21:02 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547190/ [6547191] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:33:59 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547191/ [6547192] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547192/ [6547194] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_journaling} time: 00:41:55 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547194/ [6547195] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547195/ [6547196] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547196/ [6547197] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features_no_cache} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547197/ [6547198] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547198/ [6547199] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 01:01:41 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547199/ [6547200] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8.stream}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547200/ [6547203] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547203/ [6547204] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547204/ [6547206] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} time: 00:32:37 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547206/ [6547207] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547207/ [6547209] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:34:26 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547209/ [6547210] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547210/ [6547211] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_fsstress} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547211/ [6547212] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547212/ [6547213] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547213/ [6547214] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:01 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547214/ [6547215] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/ssd 6-workloads/qemu_xfstests} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547215/ [6547217] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8.stream}} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547217/ [6547219] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:34:54 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547219/ [6547220] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547220/ [6547221] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547221/ [6547222] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:32:19 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547222/ [6547223] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/fsx} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547223/ [6547224] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547224/ [6547225] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8.stream} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547225/ [6547226] rbd/singleton/{all/qos objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8.stream}} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547226/