Found 197 jobs
Missing teuthology log /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388353/teuthology.log
Misunderstood line: 
Found 38 distinct failure reasons
Failure: "2023-09-05T12:21:30.856960+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
21 jobs: ['7388280', '7388173', '7388168', '7388273', '7388218', '7388301', '7388187', '7388189', '7388317', '7388337', '7388344', '7388228', '7388242', '7388161', '7388295', '7388287', '7388278', '7388212', '7388341', '7388345', '7388179']
suites intersection: ['1-ceph', '2-logrotate}']
suites union: ['1-ceph', '2-logrotate}', '2-workunit/ffsb}}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'clusters/1-mds-1-client-coloc', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/fixed-2-ucephfs', 'conf/{client', 'debug', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/32bits/{begin/{0-install', 'fs/functional/{begin/{0-install', 'fs/libcephfs/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/snaps/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/traceless/{begin/{0-install', 'fs/valgrind/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/whitelist_health', 'overrides/{distro/testing/k-testing', 'overrides/{faked-ino', 'overrides/{frag', 'overrides/{ignorelist_health', 'session_timeout', 'tasks/auto-repair}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/forward-scrub}', 'tasks/fragment}', 'tasks/libcephfs/{frag', 'tasks/mds-flush}', 'tasks/metrics}', 'tasks/mirror}}', 'tasks/snap-schedule}', 'tasks/snap_schedule_snapdir}', 'tasks/test_journal_migration}', 'tasks/volumes/{overrides', 'tasks/workunit/snaps}', 'tasks/{1-thrash/mds', 'test/clone}}', 'test}}', 'thrashosds-health}', 'traceless/50pc}']

Failure: ['<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'Bugzilla. In case of problems, contact the owner of this repository.', "Curl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Network is unreachable]", 'Enabling a Copr repository. Please note that this repository is not part', 'Please do not file bug reports about these packages in Fedora', 'The Fedora Project does not exercise any power over the contents of', 'and packages are not held to any quality or security level.', 'of the main distribution, and quality may vary.', 'this repository beyond the rules outlined in the Copr FAQ at']
2 jobs: ['7388313', '7388309']
suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}']
suites union: ['1-cephadm', '1-check-counter', '1-client', '2-logrotate}', '2-scrub/yes', '2-upgrade', '3-compat_client/quincy}}', '3-snaps/no', '4-flush/no', '5-workunit/suites/blogbench}}', 'begin/{0-install', 'centos_8', 'clusters/1-mds-2-client-micro', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'multimds/yes', 'n/5', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'ranks/multi/{export-check', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-octopus', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/no}']

Failure: Host key for server 'smithi148.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJc7byGD1pFofuIKgJk7qTBZPWs0c19aJbLO4zQeUYIn', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDH9teGDjQfIJg6eYYqkcRP/VRrJdqv7Ju2yWBhO1BVnrx5f0zaSy0dqqVZBrW0Gqf7GtKZoZFjdD4i3k5BlJV9DokGEn7j06ZAvDaMTQn6S9ml7jOiLhyDBeugzpeAgzFkoo9t/auF06c9ScRMzD9cbocH7F00fi0xcNPwCeJyB0l7Szmh4OKcC6UpNd/w4zk4t56FIO3lbHE4cusW4QBceHNWOrf+WBroXBHkUXixaUkToEfhxwVi5JD5eh5sOzQhqNaTDP6iwHrFxD0/N6zA8b6L26VONQDwymX1aeSlIuF8vAlB8NpD4830ri1SRxNsILYy0hmiA+fAMjpCXnP3L72qk2RS5og+BL94k1MZbm7KUfuLthehSFMIITVmt6qx2ZrxaaUgBK8V8s7yFbExMVqG851LlM4HJ1QxFkr6ArRJkBdRSeunfeDdMw/eUwklh065poCIGWoSR7CJ1sO8hOTuGC0p+WdJ72SNxVuVSN25h8N0maBfTImZxDzYsCk='
1 jobs: ['7388275']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/basic}}']

Failure: Host key for server 'smithi033.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII2b8+EHn0tR7UVQyFU4c9cfLZglh/CJaxT5iamCaOjc', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDgt/+m+Zx3ddB7u5WO5g/qF/s8evT93NNbdC+4MOjU2BoV/iWn6Gv9I7WhfVM+i557fgOj5eUMc7C2Bwp691ZtZARduEyt2U5FkF2jwLmI7bpM9DBDuedosDjAqtS6fk0PqVmlMtyJhZ5E6OBN472dkceH3+TGMHk3OVMA/lnwPpQonhb3oILDQQG8aANxFI7+JSZ0KJxhuNn9ZUdUK1sjp1FeH+sV4rGt2zzQpiub0atq/wBJ8eSy3BdoBYEuN3Pz/bBz4wyZec4ZkI1P2yMjp7dxPAFmwlOH2Q9e4qjtw90OOZdF8j1WwQx7umDJYoO3uAwDDJaWzW5VJa5aaYmgbP5K4ZUxAOkpKMcPNRtCEr5Ay+586lD8LX1M+9ynPgM3X6NBK17HgCIIp3IeRd3tD9imopTHPSIxPkSsQ35rp0HMUEiTM4zQfeV7fknUiRJ+puqeQjeig8s1V13peoSdiflC5ldnM5ybVpaJURqSBTxXXmA+Q2Y+crb7eKbyfzc='
1 jobs: ['7388177']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/snap_schedule_snapdir}']

Failure: No module named 'tasks.kclient'
6 jobs: ['7388251', '7388232', '7388255', '7388248', '7388233', '7388260']
suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'mds', 'mon', 'osd}']
suites union: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/suites/pjd}}', 'centos_latest', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a5s-mds-1c-client', 'clusters/small-cluster', 'conf/{client', 'distro/{centos_8}', 'distro/{centos_latest}', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'fs/bugs/client_trim_caps/{begin/{0-install', 'fs/mixed-clients/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/snaps/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'kclient-overrides/{distro/stock/{k-stock', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'osd-asserts}', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'overrides/{ignorelist_health', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'rhel_8}', 'session_timeout', 'tasks/failover}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/trim-i24137}', 'tasks/workunit/snaps}', 'tasks/{1-thrash/mds', 'thrashosds-health}']

Failure: Host key for server 'smithi070.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIBtMSN1hD6JjOPqkidrP6QuhdjhpZuL0mUqQPWYcMSgE', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCQZj1In+CZD14/mPNuuKYl2Mom6qcGk+l7zco5s0D80pIsjm5RVslNTIBCmINeR8cSo5LETiSjr8UL2JkxhyU6KsW5oYw2Ltf3JUm9/Pu6Ie/hbDYtyLXMipwgckzPbE9dbszQh/qUTu+ZmG/HSuRW8pj5DNuti+D2QanoU6nxund9m3i7XnKxC3wx2ch1kVjukuvRbYnGU82yVvgL1XqJxgDr6Nw501XIxQ3lLAU5buAW9BqWshw5y2Z7pgHEKCF+rKSayY74Qweg7smolveH/a8MVOwH6BAwBfBwvo5Rbxl1+892Q85Vf8KVIm+j7XmAKQU9O1ABg1HcWnkK/DBHoQXjYDRhprAtiEMdMi+7vG4dGi4xPgtkT8/vPImX6svNmRCcmiJ0pwAAxbhti8JiaGcA03W9WFExf+qyHNFoy8WzrGIiRXgLhNgn2DGCeXOXYTdMWjGC7E63JJnIa2N6BZPk2hhNInFGdVibOdjmmw8UncFreo67MHWuSUvQMJM='
1 jobs: ['7388303']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-3-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/ior-shared-file}']

Failure: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3f068cec6c5fb39569ca38ddb0f19fce7352a2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh'
2 jobs: ['7388209', '7388277']
suites intersection: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'races', 'ranks/3', 'session_timeout', 'thrashosds-health}']
suites union: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'session_timeout', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'thrashosds-health}']

Failure: Host key for server 'smithi032.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDOtm5am3jRJYE/T1fxj9/g+WXT6PoaQiADP5H0gdFe0', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC2tMjUxLR1CzgQy34DbMB6w2ntYb+VKflQ0Lst2baI41oz7RySTQ8BZXmm4qbRQSjZODLpbvC5nCtb5zTftAuLNKuGV//exhPmq9UtunHTKN+7eLfm2fUQPE8kCD7w8ZqxvTZjl6W8Z/Y7IDHMDoF78dEEz98ePdwZu6wWTADfBzSE+mYQ5oJuWLZa1gToYaBroMaWS72mzWNnDRYNqU6h3J4JfOkq0d36XKOltWiDYsrT9Jd/Rg4g1MVJ2CPY/8zTLzA3NkSDqyzYG7Vp6RcSfH5Gzd8HIOyVkajZ7rdWsDFlaYuLiykpiHRN5p0cFJArq2Rv0WdEUuKPPPlRk9832ZZGYXhAJZhHFM+3EBtlL9Y73Y1MoYB4DPStUZJ1aULjwaTGdOS/LyFfJOBorMxFM4DYGFF2S0QMZT+7W5i1/04cOAJoxuX2KPhzPJgfAeb1LWOiLovXcY04+H1I5it8dHeinP//ABKMBWqE8iJ/g/Osa/vC1hPqD2r7JJXO5Tk='
1 jobs: ['7388200']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-3-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{ignorelist_health', 'tasks/ior-shared-file}']

Failure: Command failed on smithi173 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib'
3 jobs: ['7388265', '7388258', '7388250']
suites intersection: ['1-ceph', '2-logrotate}']
suites union: ['1-ceph', '2-logrotate}', '2-three-per-cluster}', 'cephfs-mirror/{1-volume-create-rm', 'clients/{mirror}', 'cluster/{1-node}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'fs/mirror-ha/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'overrides/{whitelist_health}', 'rhel_8}', 'supported-random-distro$/{centos_latest}', 'tasks/client-recovery}', 'tasks/exports}', 'workloads/cephfs-mirror-ha-workunit}']

Failure: Command failed (workunit test fs/quota/quota.sh) on smithi052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3f068cec6c5fb39569ca38ddb0f19fce7352a2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh'
1 jobs: ['7388207']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/workunit/quota}']

Dead: b'2023-09-06T02:09:50.797 DEBUG:teuthology.exit:Finished running handlers'
4 jobs: ['7388304', '7388323', '7388203', '7388201']
suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}']
suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'frag', 'fs/functional/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/5', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'ranks/multi/{export-check', 'replication/always}', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/multifs-auth}', 'tasks/xfstests-dev}', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}']

Failure: Host key for server 'smithi057.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAICYlaLilwrGYOFacZgvfJMNiJG8T/bX383rWnoKGYVN7', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQD0nd07+IelHEWXd3xOw/He2SPqgKDycxSwGvXGRxZg2Beyjj9xv0feO+qCBdI2RbI7bqjbLUCt2Vb4bDUlZYUoVUB42HlnnHyaqUP19/HpZJiyAGAGs6fpCcJingSqe7bxXfU4gVdJKUuwZfQGTwbY80+CV46jf5EkIl5a9a4wpkuazDTmJgsxugoCBUtxyMG8KaaMlq6w22oBipwcvT0Xz7+PAi04M789o54Fob0bwZVUom68MAqFb4TULqYbv8rjGgMNznXdfmhAzWZzUkCi7bJ2QBFJVQEzSJ9UwrdX632XpjbA2ErYIaYYtbTV1rsxiNWQY0DvDj7B79URhRaR+/HsApLKleLwaEm3gfBGXXuQS7Ull2mMfbRignariCqn9T1g9zu77Qv65QZSTfoRydqUJreImUthoxMvMgHON7yVSoqG5nbKt87EqI0BKkAZrn3oK4vBO9U0ADZoS19wrEfQwhkUpZDO14TI8k4VSW4zceYAD/W1hSzUhaMERVE='
1 jobs: ['7388321']
suites: ['1-ceph', '1-tests/fscrypt-ffsb}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-client']

Dead: None
1 jobs: ['7388353']

Failure: Host key for server 'smithi104.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIOB/s24jsVWbjV1fcyP5vkvF1H3Kkfv7S76W3oPYqhOZ', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC8jmGZWHMSkjYutKUS6w9V7wIvw7vsI9jYoz8rdgYIwC/TximP5GRDQCoWGCvjfOtjrfFSWW2rdMFFBw7pwDuGOeblVmKVGm/UJnEqZyYyvKMWCGyv1MBaSKMzU/yt4xIca01RC+ocPL6lxH4U2FEI+TrirlSG2ezitQVUkR90J1Xg6hwDB9Dm7JATrj5caheizMhuFr8y8+q3IrDj16VWhLISruWI6JSMKaGGvc6vrGiBmKTsVRD8oEN0HRQPlcq+r92Y40IVlt9E527BhDDeMtZ52i1rPErY7wDg3sS+iY21KjhzFMy0mALSWzdVbe6mOEBJtqvdKfWdPHqVXFtKV3akOr60uW7b/mkabeTOfvIN3xs97+Fqq4pUNkMOT13JKIfaoUQfj+7Jh68bPkaF43NwJetPo7zr4xXZCq5EgBbBuQIwAkjhWTK6sFrySE+NM6OB4tiqA1+GyjLbvmPbf8ZEtTFyHuJkP7Mo3PWykJ6F3D5MOsPiNSRfprxRRjU='
1 jobs: ['7388266']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/cephfs_misc_tests}']

Failure: Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 196fe4f0-4be8-11ee-9ab3-7b867c8bd7da -- ceph orch host ls --format=json'
2 jobs: ['7388279', '7388204']
suites intersection: ['1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific']
suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific']

Failure: Host key for server 'smithi087.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAICCBThPdJT1HmLyckij2Eg+t8O/eoEBUntaTwXWKXTUb', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDASRSv0f41Fs3FnKFvGxS+ijKQ65yzHBKRJ2q4JmbG0HHLUgfGyxhYcFI8p0AFkjkb7LOaVnxDYJR/McIHCzXX/NUfgSuqzStmy3wLd1rVEBSj/XvgJi6RZVyqyKT/rczG1BkjgOdKY54A2dH/hRkIXRiVUGfqv7WoT1HcSx9xgem94DJ9PfqPLPLCugrQ3iR1HsTzro3HJzmM7S5adeP+NCYUUv1Mx9cVZPj7uSBtSlpPInnh7NpWtaBtd1KGvgofLSwucrBcFLTyZhyqKE3cqUFCHRjY3VHzRdGMXjgCn2N+Awvd4llibeSjeyNe0x0IvCxl1V7nUALecR+W2hkE/mcsvucQgJxoH8GPFeAIP6tY0y7+YVtLIJCvK13K2TfBp09rUI+kQP0zXjTbjrgI41ekR66WIAFdJrH9mB6dJ8SCXPP0S4nbPw0NC+RJw7d8qFlovzkZ/gQ0AyTkTLZcQrYN2n3q3VCE0hodBMKggU4cOsij8IdwEAjyjBwGiws='
1 jobs: ['7388289']
suites: ['1-ceph', '2-logrotate}', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/traceless/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{frag', 'tasks/cfuse_workunit_suites_blogbench', 'traceless/50pc}']

Failure: Host key for server 'smithi144.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDd0X8b38UkcPXtcNaP3JUC6MzmqxZMJmXBEx07JjSXQ', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDNGTwTISv62m0Uc1OdWBG+FN+mPq6qwnbd2GBUdBzCoqYoXvm6mPA5cYRkFdw+9M+VvBY+CLpvItdB3URTzZd64CWIP5sUDUexyMoLVz7htV6Xc1RN4xkxxotH/wyEp/OiWRCRPXPzAZNiZRwGfnKJRbVyHHfhmLSfWyHMHhf+sDEMLTEFJaBX2CYBow1qhhjWIOhJPmlt4SbRiAfEm6o1qTiodnGGNvlx/fhRQuE/y+1ExdQ//MBI3vj04EyPOCkv3m+beYEJjZIdOio67oySpbpbPF6flcyv1+52/V8saTwvx07jlYsJ/ReYgVJhB2lh0KgO+WnYt4po7ZV+xJ8o+P+lbcu9F1luThk27JIDrqeCZbe91kYGrRi3/fkz/Lprv4Erwu/3BBg5wzcXTlytVa4SI6dNP3Xw1mz+8U2GQFtV5I8y/rDADVchGLSl7ZehDrc1NBqWatis3Q1yxpDWLvs37i2nqIaScfOAaLe54neAYi8gqIBRkW68mGev1I0='
1 jobs: ['7388239']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/snapshot}}']

Failure: Command failed on smithi158 with status 1: 'sudo yum -y install cephfs-java'
2 jobs: ['7388235', '7388185']
suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}']
suites union: ['1-cephadm', '1-check-counter', '1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '2-logrotate}', '2-scrub/no', '3-inline/yes', '3-snaps/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-flush/no', '4-verify}', '5-upgrade-with-workload', '5-workunit/fs/norstats}}', '6-verify}}', 'begin/{0-install', 'centos_8.stream_container_tools', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fail_fs/no', 'frag', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn', 'ranks/1', 'roles', 'session_timeout}', 'standby-replay', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/no}']

Valgrind: mon (InvalidRead, Leak_PossiblyLost, Leak_StillReachable)
1 jobs: ['7388310']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/3', 'session_timeout}', 'tasks/fsstress', 'validater/valgrind}']

Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)
1 jobs: ['7388316']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/quota}']

Failure: Host key for server 'smithi096.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIICRbFLhMpLRnbUIqMIIWJvBRq0sjabYAHHeuAzXMuvY', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCixh09rEp5J3M1y+PImPscaCc7fg6nyYz4PmeG1TtdvVLzxhOqg0mSMc5nSi/pQJw+KQhe+SRSc/+a0Xeo8x6gzTkcpEXgvjSNvtCUXPpWHjf5lOwD32l3nmmBtsUwn7ANaSEaI/EGDgL4whTeST/N9T4yTyslKgLxlaT5B1/RuYp69cpn7uJZmCkhHewILWVZM6j0QUtv6LCfZTTynEdkbdQwjTnnblJluwKKNjswHycd2W72ecOIKTxrjQH6VonT9z6gYw7n4IsaHcPYo6is6T7HC3QXLAaULqXvGYSNQ2T2HxJO8vNu5Y4njEx4SwLuze/EE1fqVOwkPIwVs9OUoIgymVdxiu4Uo+tZU4HmMKaXixtGYEwtHOzPbZXwqxAc0dInfPAyCp38d413nqQyd0jLlNN3k9y12/wQK06IjZXiN2WdvDRfS/6zz3WJ6qwV3ficR5K4j/xdD0qbNcON+jIHkdlt8y+H0v9R/0JC9Yu1F4NG92U5snexnBIhb3c='
1 jobs: ['7388349']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/misc}}']

Failure: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
1 jobs: ['7388186']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/strays}']

Failure: Host key for server 'smithi052.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIFwMNJYOGZEXS/mam0yk8zWBpnV2/ePuJIGA5QQ7OOu1', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCu1F9cOuc1JdwZemXI6x+vjQsoxo5qmi+dyXHIOz4Zb7hFdVuApJfkg8FNE0HDJDT+IRf9fdDDJSOqapwrgKmh9HstHWeOEMsTBWxs6F47TptCjUBLXmRe+qUj6M/Ae19hd8NB1+V1dKlskviY48vQC1Vu5s2qfqctM1E3uCGvwI5D37G5G+tDo55tKLJVmG/5umc/dfK7VLagtsslnurUeT5iISIhKP6BiDmfDySB6PIkaDmkAwSpujTHiJqBG9IC0TqDhOvtlXNuzcLW68gWG9ef68j/NOQPp9I69i4jet0wOPBlKrBDpAOPQKG7YXtUjv0vhaiJAIGfpSRF6W1f9JDrR0yZwtUJ+Zqgw+iEoTqUcwfMwOBx8naw9kwIm8uXXXk5VUgPKjdrVmRyF9t2AoxuBxzY9HV3VFXLzydDPQUifdY4hF/gjL056bGQvGjPqVtOpRFLRpH8iA6ROYNwkeW0/ikMtigxdnR6Q/s9Fz2j1Fykf0hja/pt/K6DeE8='
1 jobs: ['7388296']
suites: ['1-ceph', '2-logrotate}', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/permission/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/cfuse_workunit_suites_pjd}']

Failure: Host key for server 'smithi007.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIAZ8bn1DHrDtuPYFrBpcjdcAY8srHHwKz8gBmEbonWpw', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC35y/lnvAX8KextUvgRYkHZQOP+ugDe1xsmc6eFaoez2U2UyPVFUbFSBefae+B0pBWr3DXDy9Lk3BioZUtNPsxaQQJ5bayl0sRwfKTk3VzzF2qNTG/TGVOapxZBb0wIJT7epy/KnkBTVDFhuCzt+LA4LjhAFfJ+8IH2KlJNELN2PJTUxx5gYnyJe5ymYqsgzQ67f4yi3synwaqMbuC+07/laD1UHxCw7SUAKHDUgD0Xbdgr5mzIeqRWo1BVx0xG8InR0KDWYv6CfoeXG5eCAjLzNGRjj9davG6kT+WyTPiUs6/vc/ntGy6m19F6mp5U6e+H/NolwAB6SKwPc1PFaszPunDNqsNWX0nhpyw0STXbWKEo9+EpkLttzHoccvKjWb1XM/DDEsVa5o1VLd1T6BTUognXdX1jhbZOK/xA5HMjjRqTJjDA90hUk0gSMUqnygPUWVZBlBu3eMHOk+f+xsyl85ihwLLaE8jRq5gnUE9JSJt0sXBKOYx4+stQE3LpvE='
1 jobs: ['7388268']
suites: ['1-ceph', '2-logrotate}', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/permission/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/cfuse_workunit_misc}']

Failure: Host key for server 'smithi019.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDeH4bqzR8hf+lroo4SUwkAh6jJWaxoyznsd1FeBIt2U', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDT0g4ZDixzZb/2Y65pwhyhD5LjtLRJV7iM/EAYauhIEyhhpmC5nCHg/efuHXGtbSgK4VBC2ZSjxtVaanIhK1AugX+1Xlzoy9ygNNkYfQQvjg7OjUvAkPXFnZhU0XIffXh2BKOtbEO8H4Mzl3g20Qy960qOXdAtqBlcohaSQvdAnLH3YTOFYhNi8I4zV5kvfsIpydAdtedxElsMfrutQ5VNfwvL6VRS3gPw4IER1A/72ZR1WlvxIuQFgE/Mg2C6yW+1FsinmmAFkkHCn6fm+hmjeEHzTkWR5lV5U3TJe/v42NCGKICepFAhmBSjTv0q+xZE1q0NM102yHp0k4eH1RqC/6uZMysMN6UFtcA2wfefWGedHD0OGlHOI1Yi6dC7A2ceTXyd1jsVlV1KuJC5K8HQ5ztDKQ36X9nUkavqj+O60NCx/hm2OzqAzgmTBSGwv0N54Y+hH6W7imSQuJy9m733//ZqbJFCgBSJ3LyX/yzAd9IgKxY8W8UJ7mdCKbVfnic='
1 jobs: ['7388169']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/cephfs_misc_tests}']

Failure: error during scrub thrashing: rank damage found: {'backtrace'}
1 jobs: ['7388176']
suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/no', '4-flush/yes', '5-workunit/suites/ffsb}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}']

Failure: Host key for server 'smithi089.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDe0KZusXAy3hcyh7yAfd/ii8w41dA9OboRgiTOj+Zne', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDUSFZbey49O+ZQbtWmyvBx5qyxDUcP4O49PxovirJOlb1I3Qbbn3mGsdKu4pkEI7V9TJzGEQBaa6JwTxafr/iKYk2gO8+u9WPcHfIdDJc6zdSz50Ik8KJ+bn+eLmHYQFSR/yP0i6fII4W4M4rTuiixLlTnDf8m5Ja9S2KmT3dJEqOkRPeyqN66X93eOQAENLpcKcM9XqZ49Ehtwe6W/Vkt4ILGM/CPhgr2ogqP6Q4Od5xf59p5SC032MrCSySvirbycWcOp6PCcXnzoyy+vMgr4RwY/nA2iP/YXZGiCJghZNTWGfBOTL5BmmreqkuGsSFQ7TCvZqKd7+dqWAqIbfZP09ewNyXh0qHX65IoZJPombjQY8RtUM8BEymY4fkg2t1ryUKHLtZ1gjEaZrFbqIow6wyObCJD4NF/EbXwWYVJhLCCoLeeh6m4Xrh7ETid8WsZtL+oS7mjX809QABl3XWlDKFXWQnvs1dbn5CzyI0jTb0sgZUYoisU0YoRZFPnvkM='
1 jobs: ['7388231']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/mdtest}']

Failure: Command failed on smithi157 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5849-g9d3f068c-1focal ceph-mds=18.0.0-5849-g9d3f068c-1focal ceph-common=18.0.0-5849-g9d3f068c-1focal ceph-fuse=18.0.0-5849-g9d3f068c-1focal ceph-test=18.0.0-5849-g9d3f068c-1focal radosgw=18.0.0-5849-g9d3f068c-1focal python-ceph=18.0.0-5849-g9d3f068c-1focal libcephfs1=18.0.0-5849-g9d3f068c-1focal libcephfs-java=18.0.0-5849-g9d3f068c-1focal libcephfs-jni=18.0.0-5849-g9d3f068c-1focal librados2=18.0.0-5849-g9d3f068c-1focal librbd1=18.0.0-5849-g9d3f068c-1focal rbd-fuse=18.0.0-5849-g9d3f068c-1focal python3-cephfs=18.0.0-5849-g9d3f068c-1focal cephfs-shell=18.0.0-5849-g9d3f068c-1focal cephfs-top=18.0.0-5849-g9d3f068c-1focal cephfs-mirror=18.0.0-5849-g9d3f068c-1focal'
1 jobs: ['7388244']
suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/trivial_sync}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health}']

Failure: Host key for server 'smithi159.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIOb3SstfDBSJ0g7HBo2dIKX0FT1spKYJ19SQpkCq/fvA', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDADn0rd2aMYBj1YOLWiFiwtYfR9HojGxmXKQZJxu0ZtB4Rtj9LOKjrjtAK0ywk3o1jCblgCZTPxVZVpppRqMoFMS83qGakDzar1cqNksxD5qV8PpqjrPipCwR1k1EJRj+lF1Kc9zqA1sc9FCj0SrRfoHhkASnk8qg5YDCCZDwbrbr9hYRdQzXEOaO5F6jjA978tKJpyKVXD7oOdv5ECUfqse1Iuc1C8Poxd4ZkcU/4Emu8L/NlRXoyuUgCdU5McYMO2kw9m4nmV/y5rVi8ebJu/reSXFX9WWbssy2T4X+P0h6g86av7JSJghk3xUI1BZ9JsxiwQsBfIh6J5AI28N8TVkzwbLZAEC6IuAOc3qzC0sbzZmn6YApXHLTefoGmN+TOMYQgwWPsKzMtjjBmhmbpQxr27cXKctmZWr62dVa9QOvg9Bt4ac7OrSIkLpiDE2hBf7pYNLfJIWKQ8q2q0Ae8vjOB2Ko95ug44/+kfPjqX3EFHa1GU0g3z7Co5by1Is0='
1 jobs: ['7388181']
suites: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_trivial_sync}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health}']

Failure: Host key for server 'smithi026.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPZp6wOILlcOVYZjlBmIruM6AFvsaBMKMhL+T3kylK03', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqi4QsBDDKbSS87JrAL5PCT9gK8O7STWIlhRnX+v5NqDPeErkcCeFQkNiLn0VxjdfUXHvIaOp2gpcKhd3Vjcb+9sHPtiNoaMWWApISdpMTZR/dUsy3/RYFkn/S2rZOz9PqNxkI7VUTu2jZuuTnv01a49FFTvaxYQrLU1VufWHxD4D8lpqhVi7sV3nWJCjpiM6cz1XM1aqUuXEiyaRR5sItrLWA4NbB5sRZcHaL775vrHTIoCj52oyliTdXcRp4TXjtPcOh+kK9UhTJKRpqmSVgh0Iw+SvM3hlNmzzaBPBnKxSOxbZda5SvZuDsi+p/dKa1Igeq9N2Z2EVfzT+eDUsDtXpczv6rdEWpUM2nl+J3M5kTDg/sLfQJJGS3YLbudCjof/FoiuTmSVW0X2tf+d+jYurb7p1STyNJDSfbQoaU1Qr7mka9PjWmh0hHVtGuoTyPwAbdKoE4wUjUDYMyioTjB2Yr529Lro2UTN7d32sCe7BQeCWBE8SQQmKsc6cDd8='
1 jobs: ['7388335']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{ignorelist_health', 'tasks/mdtest}']

Failure: Host key for server 'smithi107.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIHu0jKzltV4lyU8/IqLVQHdQQi7+e72cMVhmWrLR+NFi', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCUq0SfhkeoOQSbWAIJSVnxnSYMpnzbDt0wWiUx+glK/E+4q64qnLSM9sRV347iQmsY4AHvL9MOrTBIGBLEm6xHVHRNNZi/1hsn5gRv/sZy1KAQ6A9Idv7y3mvvYe3HCzz+MwQ5syWrQ98HeYG3Ukqo5xmtFWvXNmHf8nAySwJmwQYs/WJapNuWNUZCQTLbUtGMrP7UL6TBLmNlt+UOaQClv3XhWWMvgEa2rQxo7dRlOWFOSb/VdVZI+CcjvlgMVfHB6fplkU6yjlb28EfW27iRJr4iZqgz0iHHuN6p5zNMdq7Kf8VBrTUehgXivzwVh+j3abXXFPzhEGj7e212NTPKkGXoiBDQMBM80ggjfWfHiqYe//Og/TbgSHyPFw6nBt5F47NyAvcOyT7hoagIoce9HNpiiAU4PzwVUBAaJfxUi5qHFa/Zq189gtH3FxV9XSdBjNfM/iAv/QHQeKBGS3aGIEQCZmxuG14sobmkEv2+jAz3k3XJoZswOmnL41NB7gE='
1 jobs: ['7388325']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}']

Failure: Command failed (workunit test suites/dbench.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3f068cec6c5fb39569ca38ddb0f19fce7352a2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh'
1 jobs: ['7388162']
suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/no', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/no}']

Failure: Command failed (workunit test fs/test_python.sh) on smithi131 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d3f068cec6c5fb39569ca38ddb0f19fce7352a2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh'
1 jobs: ['7388219']
suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}']

Failure: Host key for server 'smithi118.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAILtURNgi6yyNTUi4mh1PMkzVCq6Pw2DLM4dR7pqzMB1E', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDITUwYyDNVd9scXmBRkKQtjFQ522KWzrFoXygmpc8CIIp4LTzOePO53J0hlkUtzZqt6DYfJPVeDU24pRKidEClzHuWdijGq6KkptRxRtVnbI8GGeO7dEIIfP0wsrt9DADMxZvfKlq0YFqp6J8dmNf4eHOsrP501Gl1BJqbrVMEpgl599bq2Ot28uERsxM5ADLa2H2aAzgNNfwrFEYiVVSaaGJ2Z1ZBju1ot9C4QuoFK4QbgG1OkbGIJefRbjUDA/Hm9lseSeqx0BVY90StvqLtPlXsTsPUuw2dacikrB370y1IuFg/lCVBAR3ZCLic+vaA1ubOZotyQ0xWgXl01bOLWrO/i5fECj9cMxRAZjFvjorF8Ik1ffxoWtdRovPnBwnK2pFKaJ9bmpWqy82vJem8WHoccWYUkrqRWFqVwh1L2v9YC0rUnu4L/RhNNsEuSzUqf2C34wen1BUune/Szp7xxuUHxStw0SaEMxcukcBKJ/Z/iPrIC4v89ePSzMts0K0='
1 jobs: ['7388241']
suites: ['1-ceph', '2-logrotate}', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/32bits/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{faked-ino', 'tasks/cfuse_workunit_suites_fsstress}']

Failure: Host key for server 'smithi017.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJwDHjpXiLzq7xnpjgxT7R4ubS9U+rNWfzZ/U/V6NO/G', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCO9qHbIxuv1YIKO+ICusv7rdu4Z1DfTIRSosc1NIh6aiXrPuq9xObx+6s4BHME3P3DE9pLW5EUJ8SIXzAhJSqJOTa84N8A9XHJF+29x8tgsDfUKCz5pCuoKXxkxSt16qYt1BOrLu2LSvpdVcAxu20/jhK8sMJSA7hLIRn0ZZtZyBAhRC8pU+YhkTroCVd3gMysPeqOSq7+JFSGMZ4t17LDrt49QvwpwZ7e9tmYSrXQuv8IdY//52KlCOmowzSXZf1/fWsmtVq7pTIJkmW/sZDICu33Fyvv/n23AtzhF2lYYvkz/4EKnhgJCmfGr9P3G762Zi83czcCpUG7OvkVd7pOxTzWknM17rAI5KMUfkkTUcad3b1/QGO6ibPNf7wMkscxt3PkUs6Zm53gqCkAYZltLBtDhsTPlp737wXLIPSmFH4I/xpZv2dzhQjIj2IhHxtWlpD3Dsb68da8KSCEX5BNHkX07VmvOXxEXA46chpLu8384zMhv2E5w8jzQQejFKU='
1 jobs: ['7388314']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/pool-perm}']

Failure: Host key for server 'smithi104.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIFg8qLZboxZbUQ7nI6Dda6dxG/+x1Wln7dnEOklGWNR0', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCr0BX7cpOmQMEEHvf3vS0Hc1eGERmaoShI5dOsgJ3/kaJ0QfKRyYxj9v9NLqoX9cHNLdD4UGsQmuXQtx03Ad2+MHXoC4xmDCdp93qQmRNZukuT9JsMTqPYTU5V42ZtZ6Rx3t38V0tmQdL5JonZv0xT9MtjQgBJ0ouN/VjMZcoCUZ6aPN0jMIXAVmUU7OgPATkO8NQwt0x7X9pJgq/9CMk/jHVKymzhJq18YU8vxQza1U/XtBxNNpVVOzoDp2CL8veT0cVCtSoDS2RMnAnoWlulW2DUZ9SpfdWzmUYot6IyaWdXbLmSy9aQi+hUh57CpXt8CK0xVB62324HHrOooT8sdh9CuCASDxRPIBkc5TWuXulvMaPdLz8QfyMCKJeAGTkvq1PffmPHmWR2KxZ0au9Sa6R4e4ieDuZCaP0nT1bwC0IAJ2fS6AbjDb7h/23wlSClXem2C/Qfy5CfMp2EwDQZyGs/5zvW078C8+6VQxc1ALTIP54gleiz1DHzLAYqIck='
1 jobs: ['7388238']
suites: ['1-ceph', '1-tests/fscrypt-pjd}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-client']

Failure: Host key for server 'smithi042.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIO5pg356dEuedI0vJKiCLAAQYSIzibQek8cpeqWboA09', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC3TpfIWWqYwhzBOCZBwGH0vp3i/VxqS4ueiIsm/xVpASL8aRjT5eR6TyLNHSttzwgyYCxyTxDRZEhzu2KDP7YaaRzUJApCab4/2ALaVwYVdTSn/o+GD3LmcP0IG7MQfbL1KbvksNuRy8leuhuKnmMaWQqJcSvaRAvLBhr3bTl0pWo13qbH8yJ2oDefdL7Yp9b0Vka3RaODKU3lgXi4DQ4GqpGI7N05dzedeFkjR0ykRu1euhM7z3sizu4dzpemFIpjDZgE8G6/hlSQ4E54/LPGFhHIDsb5KpHCBtdOIOd7t0KEGYb7ae/UgjE0dfdTqZ9loBbL/Wq0IwjJd1u3PcSzuZCS+7LmzYbd+ZHdaIuRlpoiAYeejI2IkVH6zuK2buyaY2pHReU3CNfziruAexXe+1ikgIW5tbMvB+ju67AP4xz/6s/v9Pbl9STXrAhhwmywUkdua1HocKEd56pTnFaS2R2xnrB7OqmEySiMRqHXRAI9w7IXQpz/ry1FGDeIQW0='
1 jobs: ['7388312']
suites: ['1-ceph', '2-logrotate}', '2-workunit/suites/iozone}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health}']

Timeout 6h running clone.client.0/qa/workunits/suites/fsstress.sh
1 jobs: ['7388227']
suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'ranks/5', 'session_timeout}', 'tasks/fsstress', 'validater/valgrind}']