2023-06-13T20:43:35.165 INFO:root:teuthology version: 0.0.1.dev122+gb580191
2023-06-13T20:43:35.166 INFO:teuthology.results:seed: '7695'
2023-06-13T20:49:03.725 INFO:root:teuthology version: 0.0.1.dev122+gb580191
2023-06-13T20:49:03.729 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-13T21:15:05.798 INFO:teuthology.results:Tests finished! gathering results...
2023-06-13T21:15:05.886 INFO:scrape:Found 2 jobs
2023-06-13T21:15:06.113 INFO:scrape:Found 2 distinct failure reasons
2023-06-13T21:15:06.114 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_mirror_compare.sh) on smithi084 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=15b0acf7f18e9709c9ba0a3b876afc20cc50d967 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/krbd_mirror_compare.sh'
2023-06-13T21:15:06.115 INFO:scrape:1 jobs: ['7303198']
2023-06-13T21:15:06.115 INFO:scrape:suites: ['conf', 'install/ceph', 'krbd:mirror-compare/{clusters/2node', 'tasks/krbd_mirror_compare}']
2023-06-13T21:15:06.115 INFO:scrape:
2023-06-13T21:15:06.116 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_mirror_compare2.sh) on smithi164 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=15b0acf7f18e9709c9ba0a3b876afc20cc50d967 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/krbd_mirror_compare2.sh'
2023-06-13T21:15:06.117 INFO:scrape:1 jobs: ['7303199']
2023-06-13T21:15:06.117 INFO:scrape:suites: ['conf', 'install/ceph', 'krbd:mirror-compare/{clusters/2node', 'tasks/krbd_mirror_compare2}']
2023-06-13T21:15:06.117 INFO:scrape:
2023-06-13T21:15:06.118 INFO:teuthology.results:Sending results to choffman@redhat.com: Test Run: choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7303198]  krbd:mirror-compare/{clusters/2node conf install/ceph tasks/krbd_mirror_compare}
-----------------------------------------------------------------
time:   00:16:55
info:   http://pulpito.ceph.com/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/7303198/
log:    http://qa-proxy.ceph.com/teuthology/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/7303198/
sentry: https://sentry.ceph.com/organizations/ceph/?query=50e98d138e6547e0a40cf64b70a166fa

    Command failed (workunit test rbd/krbd_mirror_compare.sh) on smithi084 with
    status 22: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=15b0acf7f18e9709c9ba0a3b876afc20cc50d967
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror
    RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff
    RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/krbd_mirror_compare.sh'

[7303199]  krbd:mirror-compare/{clusters/2node conf install/ceph tasks/krbd_mirror_compare2}
-----------------------------------------------------------------
time:   00:14:40
info:   http://pulpito.ceph.com/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/7303199/
log:    http://qa-proxy.ceph.com/teuthology/choffman-2023-06-13_20:41:06-krbd:mirror-compare-wip-choffman-krbd-scale-test-distro-default-smithi/7303199/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5acac56646de4fd18047004613c67e6d

    Command failed (workunit test rbd/krbd_mirror_compare2.sh) on smithi164
    with status 2: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=15b0acf7f18e9709c9ba0a3b876afc20cc50d967
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror
    RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff
    RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/krbd_mirror_compare2.sh'