2023-12-08T01:40:55.186 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T01:40:55.187 INFO:teuthology.results:seed: '7102' 2023-12-08T01:47:18.520 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T01:47:18.524 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-08T04:53:32.957 INFO:teuthology.results:Tests finished! gathering results... 2023-12-08T04:53:33.223 INFO:scrape:Found 4 jobs 2023-12-08T04:53:33.224 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482977/teuthology.log 2023-12-08T04:53:34.504 INFO:scrape:Found 2 distinct failure reasons 2023-12-08T04:53:34.505 INFO:scrape:Dead: None 2023-12-08T04:53:34.505 INFO:scrape:1 jobs: ['7482977'] 2023-12-08T04:53:34.505 INFO:scrape: 2023-12-08T04:53:34.505 INFO:scrape:Failure: Command failed (workunit test rbd/compare_mirror_images.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=940a98f2ef3280cf107b5350288a72c4163f2a42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_DEVICE_TYPE=nbd RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_images.sh' 2023-12-08T04:53:34.505 INFO:scrape:1 jobs: ['7482980'] 2023-12-08T04:53:34.505 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'conf/{disable-pool-app}', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd:mirror/{base/install', 'supported-random-distro$/{centos_latest}', 'workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd}'] 2023-12-08T04:53:34.505 INFO:scrape: 2023-12-08T04:53:34.506 INFO:teuthology.results:Sending results to rraja@redhat.com: Test Run: rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/ failed: 1 dead: 1 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [7482980] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} ----------------------------------------------------------------- time: 01:32:08 info: https://pulpito.ceph.com/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482980/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482980/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ad4374800274a3f9c018a389765be14 Command failed (workunit test rbd/compare_mirror_images.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=940a98f2ef3280cf107b5350288a72c4163f2a42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_DEVICE_TYPE=nbd RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubunt u/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_ima ges.sh' Dead ================================================================= [7482977] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-image-alternate-primary-krbd} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482977/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482977/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7482978] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-image-alternate-primary-nbd} time: 03:03:14 info: https://pulpito.ceph.com/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482978/ [7482979] rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-krbd} time: 01:33:32 info: https://pulpito.ceph.com/rraja-2023-12-08_01:38:31-rbd:mirror-main-distro-default-smithi/7482979/