Found 168 jobs
Found 6 distinct failure reasons
Failure: Command failed on smithi001 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:16f1bad757c056e85d4b15a108de800c1bde308e -v bootstrap --fsid ce858ffc-e353-11eb-8c22-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring'
10 jobs: ['6266741', '6266712', '6266781', '6266724', '6266684', '6266692', '6266688', '6266777', '6266765', '6266773']
suites intersection: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}']
suites union: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'ranks/3', 'ranks/5', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/norstats}', 'workunit/fs/test_o_trunc}', 'workunit/kernel_untar_build}', 'workunit/suites/blogbench}', 'workunit/suites/fsstress}', 'workunit/suites/fsync-tester}', 'workunit/suites/iogen}', 'workunit/suites/iozone}', 'workunit/suites/pjd}', 'wsync/{no}}', 'wsync/{yes}}']

Dead: b'2021-07-13T07:25:36.264 DEBUG:teuthology.exit:Finished running handlers'
1 jobs: ['6266666']
suites: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:workload/{begin/{0-install', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'ranks/5', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/fsx}', 'wsync/{yes}}']

Failure: Command failed on smithi042 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:16f1bad757c056e85d4b15a108de800c1bde308e -v bootstrap --fsid 0800e020-e349-11eb-8c22-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring'
2 jobs: ['6266667', '6266676']
suites intersection: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'wsync/{no}}']
suites union: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/dbench}', 'workunit/suites/fsync-tester}', 'wsync/{no}}']

Failure: error during scrub thrashing: reached maximum tries (30) after waiting for 900 seconds
2 jobs: ['6266708', '6266716']
suites intersection: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}']
suites union: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'ranks/3', 'ranks/5', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/kernel_untar_build}', 'workunit/suites/fsx}', 'wsync/{no}}', 'wsync/{yes}}']

Failure: Command failed on smithi109 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:16f1bad757c056e85d4b15a108de800c1bde308e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a7a53ce-e34b-11eb-8c22-001a4aab830c -- ceph mon dump -f json'
4 jobs: ['6266682', '6266669', '6266629', '6266700']
suites intersection: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}']
suites union: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:workload/{begin/{0-install', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'ranks/1', 'ranks/3', 'ranks/5', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/direct_io}', 'workunit/fs/test_o_trunc}', 'workunit/suites/iogen}', 'workunit/suites/pjd}', 'wsync/{no}}', 'wsync/{yes}}']

Failure: The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}
1 jobs: ['6266753']
suites: ['1-cephadm', '2-logrotate}', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'fs:workload/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'ranks/5', 'scrub/no', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}', 'wsync/{yes}}']