2023-06-19T21:34:01.861 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-19T21:34:01.862 INFO:teuthology.results:subset: '25/99' 2023-06-19T21:34:01.863 INFO:teuthology.results:seed: '3314' 2023-06-19T21:52:56.184 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-19T21:52:56.216 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-19T23:14:02.581 INFO:teuthology.results:Tests finished! gathering results... 2023-06-19T23:14:03.536 INFO:scrape:Found 20 jobs 2023-06-19T23:14:05.101 INFO:scrape:Found 1 distinct failure reasons 2023-06-19T23:14:05.102 INFO:scrape:Failure: Command failed (workunit test rbd/diff_continuous.sh) on smithi193 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' 2023-06-19T23:14:05.102 INFO:scrape:5 jobs: ['7308326', '7308329', '7308327', '7308325', '7308333'] 2023-06-19T23:14:05.103 INFO:scrape:suites intersection: ['cluster/{fixed-3', 'msgr-failures/few', 'openstack}', 'rbd/nbd/{base/install', 'thrashers/default', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2023-06-19T23:14:05.103 INFO:scrape:suites union: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2023-06-19T23:14:05.103 INFO:scrape: 2023-06-19T23:14:05.104 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [7308325] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:26 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308325/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308325/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ebb52539418e44339f93815e1ee92385 Command failed (workunit test rbd/diff_continuous.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7308326] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:45 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308326/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46412fa84deb4c1b9eb64c404abc71da Command failed (workunit test rbd/diff_continuous.sh) on smithi193 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7308327] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} ----------------------------------------------------------------- time: 00:25:15 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308327/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308327/ sentry: https://sentry.ceph.com/organizations/ceph/?query=735c395c476d4f298534c8db0e31776c Command failed (workunit test rbd/diff_continuous.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7308329] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} ----------------------------------------------------------------- time: 00:30:40 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308329/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308329/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d05dc063e5aa476c9111504ced4e4e49 Command failed (workunit test rbd/diff_continuous.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7308333] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:25 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308333/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e89c29b971a42d3bd1ef4402bbe1fdb Command failed (workunit test rbd/diff_continuous.sh) on smithi101 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a178d176935f8e6fd23e56d239b479848950cc17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=nbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' Pass ================================================================= [7308318] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:46:14 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308318/ [7308319] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:39:27 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308319/ [7308320] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:44:20 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308320/ [7308321] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:44:28 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308321/ [7308322] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:48:25 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308322/ [7308323] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:45:36 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308323/ [7308324] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:38:39 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308324/ [7308328] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:46:12 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308328/ [7308330] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:50:50 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308330/ [7308331] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:58:47 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308331/ [7308332] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:50:11 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308332/ [7308334] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:55:16 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308334/ [7308335] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:57:44 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308335/ [7308336] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 01:03:08 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308336/ [7308337] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} time: 00:54:52 info: http://pulpito.ceph.com/dis-2023-06-19_21:33:07-rbd-wip-61616-distro-default-smithi/7308337/