2024-01-10T20:59:30.822 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-10T20:59:30.822 INFO:teuthology.results:seed: '4566' 2024-01-10T21:02:40.564 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-10T21:02:40.568 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-11T00:07:54.635 INFO:teuthology.results:Tests finished! gathering results... 2024-01-11T00:07:55.076 INFO:scrape:Found 5 jobs 2024-01-11T00:07:57.532 INFO:scrape:Found 1 distinct failure reasons 2024-01-11T00:07:57.533 INFO:scrape:Failure: Command failed (workunit test rbd/compare_mirror_images.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c93cd8035be7d5ecc6bf05e6048f0bdaa2d5ccc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_DEVICE_TYPE=nbd RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_images.sh' 2024-01-11T00:07:57.533 INFO:scrape:2 jobs: ['7512705', '7512706'] 2024-01-11T00:07:57.533 INFO:scrape:suites intersection: ['clients/{mirror-extra', 'cluster/{2-node', 'conf/{disable-pool-app}', 'mirror}', 'msgr-failures/few', 'openstack}', 'rbd:mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd}'] 2024-01-11T00:07:57.533 INFO:scrape:suites union: ['clients/{mirror-extra', 'cluster/{2-node', 'conf/{disable-pool-app}', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd:mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd}'] 2024-01-11T00:07:57.533 INFO:scrape: 2024-01-11T00:07:57.534 INFO:teuthology.results:Sending results to rraja@redhat.com: Test Run: rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [7512705] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} ----------------------------------------------------------------- time: 02:57:30 info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512705/ log: http://qa-proxy.ceph.com/teuthology/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512705/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0af716f09b84f418d597968ff896891 Command failed (workunit test rbd/compare_mirror_images.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c93cd8035be7d5ecc6bf05e6048f0bdaa2d5ccc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_DEVICE_TYPE=nbd RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubunt u/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_ima ges.sh' [7512706] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} ----------------------------------------------------------------- time: 01:34:52 info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512706/ log: http://qa-proxy.ceph.com/teuthology/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4354863479e24cdc994d48d24d4844ce Command failed (workunit test rbd/compare_mirror_images.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c93cd8035be7d5ecc6bf05e6048f0bdaa2d5ccc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_DEVICE_TYPE=nbd RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubunt u/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_ima ges.sh' Pass ================================================================= [7512703] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} time: 02:27:33 info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512703/ [7512704] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} time: 02:26:28 info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512704/ [7512707] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} time: 02:25:24 info: https://pulpito.ceph.com/rraja-2024-01-10_20:58:46-rbd:mirror-main-distro-default-smithi/7512707/