2022-01-26T14:47:05.344 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-26T14:47:05.346 INFO:teuthology.results:seed: '1713' 2022-01-26T14:55:23.992 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-26T14:55:23.995 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-26T16:19:30.336 INFO:teuthology.results:Tests finished! gathering results... 2022-01-26T16:19:31.893 INFO:scrape:Found 16 jobs 2022-01-26T16:19:32.158 INFO:scrape:Found 1 distinct failure reasons 2022-01-26T16:19:32.159 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ccf25121d489f6b6830278aea746fb4a2a2cec72 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh' 2022-01-26T16:19:32.159 INFO:scrape:1 jobs: ['6641474'] 2022-01-26T16:19:32.160 INFO:scrape:suites: ['clusters/1a3s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:snaps/{begin', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{whitelist_health', 'tasks/workunit/snaps}', 'whitelist_wrongly_marked_down}'] 2022-01-26T16:19:32.160 INFO:scrape: 2022-01-26T16:19:32.162 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [6641474] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} ----------------------------------------------------------------- time: 00:22:25 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641474/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641474/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca0acb69646645699d866e36ae602e8d Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ccf25121d489f6b6830278aea746fb4a2a2cec72 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest- multiple-capsnaps.sh' Pass ================================================================= [6641469] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:47:25 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641469/ [6641470] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:51:41 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641470/ [6641471] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:43:28 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641471/ [6641472] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:59:49 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641472/ [6641473] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:39:37 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641473/ [6641475] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:36:31 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641475/ [6641476] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:06:37 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641476/ [6641477] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:39:37 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641477/ [6641478] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:59:28 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641478/ [6641479] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:46:11 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641479/ [6641480] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:56:48 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641480/ [6641481] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:35:03 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641481/ [6641482] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:58:10 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641482/ [6641483] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:41:35 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641483/ [6641484] fs:snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:15:20 info: http://pulpito.ceph.com/mchangir-2022-01-26_14:45:33-fs:snaps-wip-mchangir-mgr-snap_schedule-retesting-branch-distro-default-smithi/6641484/