2021-12-02T08:30:07.206 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-02T08:30:07.207 INFO:teuthology.results:subset: '19952/100000' 2021-12-02T08:30:07.208 INFO:teuthology.results:seed: '3054' 2021-12-02T14:13:20.501 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-02T14:13:20.534 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-12-02T17:31:37.618 INFO:teuthology.results:Tests finished! gathering results... 2021-12-02T17:31:55.667 INFO:scrape:Found 178 jobs 2021-12-02T17:31:55.816 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532790/teuthology.log 2021-12-02T17:31:58.615 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.616 WARNING:scrape:Not-understood crash indication 2021-12-02T17:31:58.645 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.646 WARNING:scrape:Not-understood crash indication 2021-12-02T17:31:58.672 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.673 WARNING:scrape:Not-understood crash indication 2021-12-02T17:31:58.698 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.699 WARNING:scrape:Not-understood crash indication 2021-12-02T17:31:58.735 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.736 WARNING:scrape:Not-understood crash indication 2021-12-02T17:31:58.760 WARNING:scrape:Not-understood crash indication 2021-12-02T11:35:15.458 INFO:tasks.qemu.client.0.gibba038.stderr:daemon-helper: command crashed with signal 6 2021-12-02T17:31:58.761 WARNING:scrape:Not-understood crash indication 2021-12-02T17:32:01.742 INFO:scrape:Found 9 distinct failure reasons 2021-12-02T17:32:01.743 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on gibba010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=30ad0105662da9899a47162d2557a692f4fb2b7d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 2021-12-02T17:32:01.744 INFO:scrape:2 jobs: ['6532768', '6532901'] 2021-12-02T17:32:01.744 INFO:scrape:suites intersection: ['2-cluster/{fix-2', '6-workloads/c_api_tests_with_defaults}', 'openstack}', 'rbd/persistent-writeback-cache/{1-base/install'] 2021-12-02T17:32:01.745 INFO:scrape:suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '3-supported-random-distro$/{ubuntu_latest}', '4-pool/big-cache', '4-pool/cache', '5-cache-mode/rwl', '5-cache-mode/ssd', '6-workloads/c_api_tests_with_defaults}', 'openstack}', 'rbd/persistent-writeback-cache/{1-base/install'] 2021-12-02T17:32:01.745 INFO:scrape: 2021-12-02T17:32:01.746 INFO:scrape:Dead: None 2021-12-02T17:32:01.746 INFO:scrape:2 jobs: ['6532790', '6532855'] 2021-12-02T17:32:01.747 INFO:scrape: 2021-12-02T17:32:01.747 INFO:scrape:Failure: "2021-12-02T14:23:29.307030+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2021-12-02T17:32:01.747 INFO:scrape:10 jobs: ['6532908', '6532881', '6532861', '6532865', '6532777', '6532860', '6532897', '6532853', '6532753', '6532876'] 2021-12-02T17:32:01.748 INFO:scrape:suites intersection: ['openstack}'] 2021-12-02T17:32:01.748 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'config/permit-partial-discard', 'features/defaults', 'min-compat-client/default', 'min-compat-client/octopus', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'pool/ec-cache-pool', 'pool/ec-data-pool', 'pool/none', 'pool/small-cache-pool', 'qemu/xfstests', 'rbd-mirror/four-per-cluster', 'rbd/encryption/{cache/writeback', 'rbd/librbd/{cache/writearound', 'rbd/librbd/{cache/writeback', 'rbd/librbd/{cache/writethrough', 'rbd/maintenance/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'rbd/qemu/{cache/none', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}', 'workloads/dynamic_features}', 'workloads/qemu_fsstress}', 'workloads/qemu_xfstests_luks2}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}'] 2021-12-02T17:32:01.749 INFO:scrape: 2021-12-02T17:32:01.749 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2021-12-02T17:32:01.750 INFO:scrape:1 jobs: ['6532899'] 2021-12-02T17:32:01.750 INFO:scrape:suites: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8.stream}', 'workloads/rbd_cli_generic}'] 2021-12-02T17:32:01.751 INFO:scrape: 2021-12-02T17:32:01.751 INFO:scrape:Failure: Command failed on gibba042 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2021-12-02T17:32:01.752 INFO:scrape:3 jobs: ['6532757', '6532819', '6532846'] 2021-12-02T17:32:01.752 INFO:scrape:suites intersection: ['openstack}', 'supported-random-distro$/{centos_8.stream}'] 2021-12-02T17:32:01.753 INFO:scrape:suites union: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-stupid', 'openstack}', 'pool/ceph_and_immutable_object_cache', 'pool/small-cache-pool', 'rbd/encryption/{cache/writearound', 'rbd/encryption/{cache/writeback', 'rbd/immutable-object-cache/{clusters/{fix-2', 'supported-random-distro$/{centos_8.stream}', 'workloads/qemu_on_immutable_object_cache_and_thrash}', 'workloads/qemu_xfstests_luks1}', 'workloads/qemu_xfstests_luks2}'] 2021-12-02T17:32:01.753 INFO:scrape: 2021-12-02T17:32:01.753 INFO:scrape:Failure: Command failed on gibba038 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term /usr/libexec/qemu-kvm -enable-kvm -nographic -cpu host -smp 1 -m 4096 -cdrom /home/ubuntu/cephtest/qemu/client.0.iso -drive file=/dev/nbd0,format=raw,if=virtio,cache=none -drive file=/dev/nbd1,format=raw,if=virtio,cache=none -drive file=/dev/nbd2,format=raw,if=virtio,cache=none' 2021-12-02T17:32:01.754 INFO:scrape:1 jobs: ['6532812'] 2021-12-02T17:32:01.754 INFO:scrape:suites: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'pool/none', 'rbd/encryption/{cache/none', 'supported-random-distro$/{centos_8.stream}', 'workloads/qemu_xfstests_luks2}'] 2021-12-02T17:32:01.755 INFO:scrape: 2021-12-02T17:32:01.755 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2021-12-02T17:32:01.756 INFO:scrape:1 jobs: ['6532847'] 2021-12-02T17:32:01.756 INFO:scrape:suites: ['clusters/{fixed-2', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rbd/thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_fsx_cache_writethrough}'] 2021-12-02T17:32:01.757 INFO:scrape: 2021-12-02T17:32:01.757 INFO:scrape:Failure: Command failed on gibba032 with status 151: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 6000 -M pool_client.0 image_client.0' 2021-12-02T17:32:01.758 INFO:scrape:1 jobs: ['6532781'] 2021-12-02T17:32:01.758 INFO:scrape:suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_fsx_nbd}'] 2021-12-02T17:32:01.759 INFO:scrape: 2021-12-02T17:32:01.759 INFO:scrape:Failure: Command failed on gibba026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:69b04de2932d00fc7fcaa14c718595ec42f18e67 -v bootstrap --fsid 2e1267da-5373-11ec-8c2e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.126 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-12-02T17:32:01.760 INFO:scrape:1 jobs: ['6532878'] 2021-12-02T17:32:01.761 INFO:scrape:suites: ['cluster/{fixed-3', 'openstack}', 'rbd/iscsi/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/cephadm_iscsi}'] 2021-12-02T17:32:01.761 INFO:scrape: 2021-12-02T17:32:01.768 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/ failed: 20 dead: 2 running: 0 waiting: 0 queued: 0 passed: 156 Fail ================================================================= [6532753] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:37:21 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532753/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532753/ "2021-12-02T09:41:20.004846+0000 mon.a (mon.0) 808 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [6532757] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks1} ----------------------------------------------------------------- time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532757/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532757/ Command failed on gibba042 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [6532768] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/big-cache 5-cache-mode/ssd 6-workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532768/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532768/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4d63919e0bd4f3ea750ecc21b0a4549 Command failed (workunit test rbd/test_librbd.sh) on gibba010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=30ad0105662da9899a47162d2557a692f4fb2b7d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6532777] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532777/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532777/ "2021-12-02T10:12:16.580353+0000 mon.a (mon.0) 122 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6532781] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532781/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532781/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28b6ccab16b64d449a09091a628ac4d7 Command failed on gibba032 with status 151: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 6000 -M pool_client.0 image_client.0' [6532812] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532812/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532812/ Command failed on gibba038 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term /usr/libexec/qemu-kvm -enable-kvm -nographic -cpu host -smp 1 -m 4096 -cdrom /home/ubuntu/cephtest/qemu/client.0.iso -drive file=/dev/nbd0,format=raw,if=virtio,cache=none -drive file=/dev/nbd1,format=raw,if=virtio,cache=none -drive file=/dev/nbd2,format=raw,if=virtio,cache=none' [6532819] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8.stream} workloads/qemu_on_immutable_object_cache_and_thrash} ----------------------------------------------------------------- time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532819/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532819/ Command failed on gibba031 with status 1: 'test -n "$(ls /tmp/ceph- immutable-object-cache )"' [6532846] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532846/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532846/ Command failed on gibba018 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [6532847] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} ----------------------------------------------------------------- time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532847/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532847/ sentry: https://sentry.ceph.com/organizations/ceph/?query=716e66911aca4fc4aa4a6aa15205a0e6 reached maximum tries (90) after waiting for 540 seconds [6532853] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:55:23 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532853/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532853/ "2021-12-02T12:48:47.415507+0000 mon.a (mon.0) 252 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [6532860] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} ----------------------------------------------------------------- time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532860/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532860/ "2021-12-02T13:02:30.559392+0000 mon.a (mon.0) 713 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [6532861] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:57:46 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532861/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532861/ "2021-12-02T12:59:53.500724+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [6532865] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532865/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532865/ "2021-12-02T13:04:48.349927+0000 mon.a (mon.0) 117 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6532876] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532876/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532876/ "2021-12-02T13:39:01.212729+0000 mon.a (mon.0) 719 : cluster [WRN] Health check failed: Degraded data redundancy: 1/2881 objects degraded (0.035%), 1 pg degraded (PG_DEGRADED)" in cluster log [6532878] rbd/iscsi/{base/install cluster/{fixed-3 openstack} supported-random-distro$/{rhel_8} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532878/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532878/ sentry: https://sentry.ceph.com/organizations/ceph/?query=220986a32b7542a68ed7f1c668d42b78 Command failed on gibba026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:69b04de2932d00fc7fcaa14c718595ec42f18e67 -v bootstrap --fsid 2e1267da-5373-11ec-8c2e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.126 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [6532881] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:36:50 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532881/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532881/ "2021-12-02T13:32:13.764608+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: Degraded data redundancy: 10/6712 objects degraded (0.149%), 1 pg degraded (PG_DEGRADED)" in cluster log [6532897] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8.stream} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:34:26 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532897/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532897/ "2021-12-02T14:16:14.227622+0000 mon.a (mon.0) 938 : cluster [WRN] Health check failed: Degraded data redundancy: 2/1384 objects degraded (0.145%), 2 pgs degraded (PG_DEGRADED)" in cluster log [6532899] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 03:35:41 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532899/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dcd4f7e195664949841175128a1987fb Command failed (workunit test rbd/cli_generic.sh) on gibba026 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=30ad0105662da9899a47162d2557a692f4fb2b7d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' [6532901] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:39:11 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532901/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=930aca3e5b8f4a33a064eb857329437c Command failed (workunit test rbd/test_librbd.sh) on gibba023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=30ad0105662da9899a47162d2557a692f4fb2b7d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6532908] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532908/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532908/ sentry: https://sentry.ceph.com/organizations/ceph/?query=181b0a73270e45458416161a2c73f8e7 "2021-12-02T14:23:29.307030+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Dead ================================================================= [6532790] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532790/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532790/ Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds [6532855] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532855/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532855/ Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds Pass ================================================================= [6532737] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{centos_8.stream} workloads/c_api_tests_with_defaults} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532737/ [6532738] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532738/ [6532739] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532739/ [6532740] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/python_api_tests_with_defaults} time: 00:29:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532740/ [6532741] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_luks_encryption} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532741/ [6532742] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532742/ [6532743] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532743/ [6532744] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532744/ [6532745] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_fsstress} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532745/ [6532746] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532746/ [6532747] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:22:25 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532747/ [6532748] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} time: 00:41:08 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532748/ [6532749] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532749/ [6532750] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:30:50 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532750/ [6532751] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:31:51 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532751/ [6532752] rbd/singleton/{all/verify_pool objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532752/ [6532754] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:07:03 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532754/ [6532755] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/python_api_tests_with_journaling} time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532755/ [6532756] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{centos_8.stream} workloads/rbd_cli_migration} time: 00:25:57 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532756/ [6532758] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} time: 00:32:55 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532758/ [6532759] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532759/ [6532760] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{centos_8.stream} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532760/ [6532761] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532761/ [6532762] rbd/singleton/{all/admin_socket objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:01 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532762/ [6532763] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/journal} time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532763/ [6532764] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532764/ [6532765] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:54:18 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532765/ [6532766] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532766/ [6532767] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532767/ [6532769] rbd/singleton/{all/formatted-output objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532769/ [6532770] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/fsx} time: 00:18:17 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532770/ [6532771] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} time: 00:25:35 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532771/ [6532772] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} time: 01:08:25 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532772/ [6532773] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} time: 00:40:48 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532773/ [6532774] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532774/ [6532775] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532775/ [6532776] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/rbd_cli_generic} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532776/ [6532778] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532778/ [6532779] rbd/singleton/{all/merge_diff objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532779/ [6532780] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{centos_8.stream} workloads/rbd_cli_generic} time: 00:20:36 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532780/ [6532782] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:47 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532782/ [6532783] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} time: 00:18:21 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532783/ [6532784] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:30:30 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532784/ [6532785] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532785/ [6532786] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532786/ [6532787] rbd/singleton/{all/permissions objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532787/ [6532788] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} tasks/rbd_api_tests_old_format} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532788/ [6532789] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests} time: 00:37:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532789/ [6532791] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532791/ [6532792] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/rbd_cli_groups} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532792/ [6532793] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532793/ [6532794] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532794/ [6532795] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532795/ [6532796] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532796/ [6532797] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8.stream}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532797/ [6532798] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:56:08 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532798/ [6532799] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532799/ [6532800] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/fio} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532800/ [6532801] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_fsstress} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532801/ [6532802] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/dynamic_features_no_cache} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532802/ [6532803] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:29:40 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532803/ [6532804] rbd/singleton/{all/qemu-iotests-writearound objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532804/ [6532805] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532805/ [6532806] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/c_api_tests_with_defaults} time: 00:39:56 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532806/ [6532807] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532807/ [6532808] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532808/ [6532809] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532809/ [6532810] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532810/ [6532811] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532811/ [6532813] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8.stream} workloads/rebuild_object_map} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532813/ [6532814] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532814/ [6532815] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532815/ [6532816] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-fsx-workunit} time: 00:30:56 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532816/ [6532817] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532817/ [6532818] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532818/ [6532820] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532820/ [6532821] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532821/ [6532822] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532822/ [6532823] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532823/ [6532824] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532824/ [6532825] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/c_api_tests_with_journaling} time: 00:46:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532825/ [6532826] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{centos_8.stream} workloads/python_api_tests_with_journaling} time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532826/ [6532827] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532827/ [6532828] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532828/ [6532829] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8.stream} workloads/rbd_cli_luks_encryption} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532829/ [6532830] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532830/ [6532831] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-journal-stress-workunit} time: 00:59:58 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532831/ [6532832] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/big-cache 5-cache-mode/ssd 6-workloads/qemu_xfstests} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532832/ [6532833] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532833/ [6532834] rbd/singleton/{all/qos objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} time: 00:33:54 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532834/ [6532835] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532835/ [6532836] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532836/ [6532837] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:26:15 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532837/ [6532838] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532838/ [6532839] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532839/ [6532840] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532840/ [6532841] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-comp-zlib openstack supported-random-distro$/{rhel_8}} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532841/ [6532842] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532842/ [6532843] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/fsx} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532843/ [6532844] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_fio} time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532844/ [6532845] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} time: 00:26:05 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532845/ [6532848] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-journal-workunit} time: 00:33:42 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532848/ [6532849] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532849/ [6532850] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:49:45 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532850/ [6532851] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532851/ [6532852] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532852/ [6532854] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532854/ [6532856] rbd/singleton/{all/rbd_tasks objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532856/ [6532857] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} time: 00:21:35 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532857/ [6532858] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532858/ [6532859] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532859/ [6532862] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532862/ [6532863] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532863/ [6532864] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8.stream} 4-pool/cache 5-cache-mode/rwl 6-workloads/recovery} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532864/ [6532866] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8.stream} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532866/ [6532867] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532867/ [6532868] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532868/ [6532869] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532869/ [6532870] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532870/ [6532871] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532871/ [6532872] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532872/ [6532873] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532873/ [6532874] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532874/ [6532875] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests_with_defaults} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532875/ [6532877] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532877/ [6532879] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532879/ [6532880] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532880/ [6532882] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8.stream}} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532882/ [6532883] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_groups} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532883/ [6532884] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532884/ [6532885] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_journal} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532885/ [6532886] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/rbd_cli_import_export} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532886/ [6532887] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532887/ [6532888] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532888/ [6532889] rbd/singleton/{all/read-flags-writeback objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532889/ [6532890] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} time: 00:19:31 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532890/ [6532891] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532891/ [6532892] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532892/ [6532893] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532893/ [6532894] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532894/ [6532895] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/python_api_tests_with_journaling} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532895/ [6532896] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8.stream} thrashers/cache thrashosds-health workloads/rbd_fsx_nocache} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532896/ [6532898] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 01:08:24 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532898/ [6532900] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532900/ [6532902] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8.stream} workloads/rbd_cli_import_export} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532902/ [6532903] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532903/ [6532904] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{centos_8} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532904/ [6532905] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532905/ [6532906] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532906/ [6532907] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532907/ [6532909] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532909/ [6532910] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532910/ [6532911] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} time: 00:50:57 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532911/ [6532912] rbd/singleton/{all/verify_pool objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8.stream}} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532912/ [6532913] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8.stream} workloads/rbd-mirror-journal-workunit} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532913/ [6532914] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2021-11-29_02:01:05-rbd-master-distro-default-gibba/6532914/