Found 200 jobs
Missing teuthology log /home/teuthworker/archive/xiubli-2021-03-27_04:21:30-fs:functional-wip-lxb-libcephfs-testing-20210226-distro-basic-smithi/6003102/teuthology.log
Found 9 distinct failure reasons
Dead: None
1 jobs: ['6003102']

Failure: Command failed (workunit test fs/quota/quota.sh) on smithi166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=51761a70c38f1ba386d77702e11f5b7560b8f41e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh'
1 jobs: ['6003017']
suites: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/stock/{k-stock.yaml', 'overrides/{frag_enable.yaml', 'rhel_8.yaml}', 'tasks/workunit/quota.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)
3 jobs: ['6003060', '6003028', '6002932']
suites intersection: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/damage.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']
suites union: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{centos_8.yaml}', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/testing/{flavor/centos_latest.yaml', 'overrides/{distro/testing/{flavor/ubuntu_latest.yaml', 'overrides/{frag_enable.yaml', 'tasks/damage.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)
4 jobs: ['6003003', '6003067', '6003035', '6002939']
suites intersection: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/mds-full.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']
suites union: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{centos_8.yaml}', 'distro/{rhel_8.yaml}', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/stock/{k-stock.yaml', 'overrides/{distro/testing/{flavor/centos_latest.yaml', 'overrides/{distro/testing/{flavor/ubuntu_latest.yaml', 'overrides/{frag_enable.yaml', 'rhel_8.yaml}', 'tasks/mds-full.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Crash: Command failed on smithi143 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump"
ceph version 17.0.0-2523-g51761a70 (51761a70c38f1ba386d77702e11f5b7560b8f41e) quincy (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f1be4e03980]
 2: (Client::_close_sessions()+0x5d) [0x55f5491bd74d]
 3: (Client::shutdown()+0x12a) [0x55f5491be21a]
 4: (StandaloneClient::shutdown()+0x9) [0x55f5491bed29]
 5: main()
 6: __libc_start_main()
 7: _start()
2 jobs: ['6002979', '6003107']
suites intersection: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/sessionmap.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']
suites union: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{rhel_8.yaml}', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/sessionmap.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
1 jobs: ['6002980']
suites: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{distro/stock/{k-stock.yaml', 'overrides/{frag_enable.yaml', 'rhel_8.yaml}', 'tasks/snap-schedule.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
3 jobs: ['6003108', '6003076', '6003044']
suites intersection: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'fs:functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/snap-schedule.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']
suites union: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{centos_8.yaml}', 'distro/{rhel_8.yaml}', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/stock/{k-stock.yaml', 'overrides/{distro/testing/{flavor/centos_latest.yaml', 'overrides/{distro/testing/{flavor/ubuntu_latest.yaml', 'overrides/{frag_enable.yaml', 'rhel_8.yaml}', 'tasks/snap-schedule.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_multiple_path_r (tasks.cephfs.test_admin.TestSubCmdFsAuthorize)
2 jobs: ['6002987', '6003115']
suites intersection: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'osd.yaml}', 'overrides/{distro/testing/{flavor/ubuntu_latest.yaml', 'overrides/{frag_enable.yaml', 'tasks/admin.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']
suites union: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{rhel_8.yaml}', 'distro/{ubuntu_latest.yaml}', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/testing/{flavor/ubuntu_latest.yaml', 'overrides/{frag_enable.yaml', 'tasks/admin.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']

Failure: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
1 jobs: ['6002948']
suites: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{centos_8.yaml}', 'fs:functional/{begin.yaml', 'k-testing.yaml}', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{distro/testing/{flavor/centos_latest.yaml', 'overrides/{frag_enable.yaml', 'tasks/snap-schedule.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']