2021-05-27T13:25:58.681 INFO:root:teuthology version: 1.1.0-f359b10d 2021-05-27T13:25:58.683 INFO:teuthology.results:subset: '3/4' 2021-05-27T13:25:58.683 INFO:teuthology.results:seed: '4656' 2021-05-27T14:21:26.839 INFO:root:teuthology version: 1.1.0-f359b10d 2021-05-27T14:21:26.844 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-27T14:37:28.033 INFO:teuthology.results:Tests finished! gathering results... 2021-05-27T14:37:29.746 INFO:scrape:Found 12 jobs 2021-05-27T14:37:30.119 INFO:scrape:Found 2 distinct failure reasons 2021-05-27T14:37:30.120 INFO:scrape:Failure: Could not reconnect to ubuntu@gibba001.front.sepia.ceph.com 2021-05-27T14:37:30.120 INFO:scrape:1 jobs: ['6137882'] 2021-05-27T14:37:30.121 INFO:scrape:suites: ['clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/libcephfs}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-05-27T14:37:30.121 INFO:scrape: 2021-05-27T14:37:30.122 INFO:scrape:Failure: Command failed (workunit test libcephfs/test.sh) on gibba028 with status 141: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=da9788a9b56ba0c4f74218f8d3f7fa9b44876961 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2021-05-27T14:37:30.122 INFO:scrape:1 jobs: ['6137881'] 2021-05-27T14:37:30.123 INFO:scrape:suites: ['clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/libcephfs}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-05-27T14:37:30.123 INFO:scrape: 2021-05-27T14:37:30.125 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 10 Fail ================================================================= [6137881] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137881/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137881/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63934aab71df4d2e8bc3b55730a9ef3e Command failed (workunit test libcephfs/test.sh) on gibba028 with status 141: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=da9788a9b56ba0c4f74218f8d3f7fa9b44876961 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' [6137882] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137882/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137882/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c38f8b06cc814da2b158141f125d857c Could not reconnect to ubuntu@gibba001.front.sepia.ceph.com Pass ================================================================= [6137874] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:10:16 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137874/ [6137875] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:10:26 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137875/ [6137876] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:10:23 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137876/ [6137877] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:10:41 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137877/ [6137878] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:10:47 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137878/ [6137879] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:10:36 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137879/ [6137880] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} time: 00:10:57 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137880/ [6137883] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} time: 00:10:52 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137883/ [6137884] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} time: 00:10:27 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137884/ [6137885] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} time: 00:10:36 info: http://pulpito.ceph.com/vshankar-2021-05-27_13:25:11-fs-wip-cephfs-mirror-incremental-sync-20210525-084706-distro-basic-gibba/6137885/