2024-01-25T09:51:58.774 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-25T09:51:58.775 INFO:teuthology.results:subset: '48/1024' 2024-01-25T09:51:58.775 INFO:teuthology.results:seed: '2348' 2024-01-25T10:03:20.635 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-25T10:03:20.639 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-25T11:42:27.851 INFO:teuthology.results:Tests finished! gathering results... 2024-01-25T11:42:28.587 INFO:scrape:Found 12 jobs 2024-01-25T11:42:41.031 INFO:scrape:Found 10 distinct failure reasons 2024-01-25T11:42:41.032 INFO:scrape:Failure: Test failure: test_multiple_path_r (tasks.cephfs.test_admin.TestFsAuthorize) 2024-01-25T11:42:41.032 INFO:scrape:1 jobs: ['7531311'] 2024-01-25T11:42:41.032 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'subvol_versions/create_subvol_version_v1', 'tasks/admin}'] 2024-01-25T11:42:41.032 INFO:scrape: 2024-01-25T11:42:41.032 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-01-25T11:42:41.032 INFO:scrape:2 jobs: ['7531310', '7531316'] 2024-01-25T11:42:41.032 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}'] 2024-01-25T11:42:41.033 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/volumes/{overrides', 'test/clone}}'] 2024-01-25T11:42:41.033 INFO:scrape: 2024-01-25T11:42:41.033 INFO:scrape:Failure: Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-01-25T11:42:41.033 INFO:scrape:1 jobs: ['7531307'] 2024-01-25T11:42:41.033 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/ignorelist_health', 'tasks/mirror}}'] 2024-01-25T11:42:41.033 INFO:scrape: 2024-01-25T11:42:41.033 INFO:scrape:Failure: error during scrub thrashing: rank damage found: {'backtrace'} 2024-01-25T11:42:41.033 INFO:scrape:1 jobs: ['7531309'] 2024-01-25T11:42:41.033 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/no', '4-flush/no', '5-workunit/kernel_untar_build}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/3', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'ranks/multi/{balancer/automatic', 'replication/always}', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'wsync/no}'] 2024-01-25T11:42:41.033 INFO:scrape: 2024-01-25T11:42:41.033 INFO:scrape:Failure: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-25T11:42:41.034 INFO:scrape:2 jobs: ['7531308', '7531315'] 2024-01-25T11:42:41.034 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{overrides', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'session_timeout}', 'tasks/fsstress', 'ubuntu_latest}}', 'validater/valgrind}'] 2024-01-25T11:42:41.034 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{overrides', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'ranks/1', 'ranks/3', 'session_timeout}', 'tasks/fsstress', 'ubuntu_latest}}', 'validater/valgrind}'] 2024-01-25T11:42:41.034 INFO:scrape: 2024-01-25T11:42:41.034 INFO:scrape:Failure: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T11:42:41.034 INFO:scrape:1 jobs: ['7531317'] 2024-01-25T11:42:41.034 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/multifs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/multifs-auth}'] 2024-01-25T11:42:41.034 INFO:scrape: 2024-01-25T11:42:41.034 INFO:scrape:Failure: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-25T11:42:41.034 INFO:scrape:1 jobs: ['7531314'] 2024-01-25T11:42:41.034 INFO:scrape:suites: ['1-ceph', '1-tests/fscrypt-common}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'osd', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-client'] 2024-01-25T11:42:41.034 INFO:scrape: 2024-01-25T11:42:41.035 INFO:scrape:Failure: Command failed (workunit test suites/dbench.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c102f04727ad86d83e0ca9348b7b0596f339d20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-01-25T11:42:41.035 INFO:scrape:1 jobs: ['7531312'] 2024-01-25T11:42:41.035 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'n/3', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{balancer/random', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-quota}', 'wsync/yes}'] 2024-01-25T11:42:41.035 INFO:scrape: 2024-01-25T11:42:41.035 INFO:scrape:Failure: Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1db5459e688287ea17e1bda532d3c81a51b40e23 pull' 2024-01-25T11:42:41.035 INFO:scrape:1 jobs: ['7531306'] 2024-01-25T11:42:41.035 INFO:scrape:suites: ['conf/{client', 'fs/nfs/{cluster/{1-node}', 'mds', 'mon', 'osd}', 'overrides/ignorelist_health', 'supported-random-distros$/{centos_latest}', 'tasks/nfs}'] 2024-01-25T11:42:41.035 INFO:scrape: 2024-01-25T11:42:41.035 INFO:scrape:Failure: Command failed (workunit test suites/ffsb.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c102f04727ad86d83e0ca9348b7b0596f339d20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-01-25T11:42:41.035 INFO:scrape:1 jobs: ['7531313'] 2024-01-25T11:42:41.035 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/ffsb}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'n/5', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{balancer/random', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/yes}'] 2024-01-25T11:42:41.035 INFO:scrape: 2024-01-25T11:42:41.036 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi ================================================================= info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/ failed: 12 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7531306] fs/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} ----------------------------------------------------------------- time: 00:10:04 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531306/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7e8585944a94ba7b204ed6cd307cb8a Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:1db5459e688287ea17e1bda532d3c81a51b40e23 pull' [7531307] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} ----------------------------------------------------------------- time: 00:34:27 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531307/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531307/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b53200646f4490c9231bfca19a9b8cc Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) [7531308] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 01:20:28 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531308/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531308/ valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions [7531309] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} ----------------------------------------------------------------- time: 00:47:08 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531309/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531309/ error during scrub thrashing: rank damage found: {'backtrace'} [7531310] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} ----------------------------------------------------------------- time: 00:52:09 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531310/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531310/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61a4432d37e948b2bddad8c2c1989812 Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) [7531311] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:36:13 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531311/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531311/ sentry: https://sentry.ceph.com/organizations/ceph/?query=669d7738b8454d0695846e2c54f540e7 Test failure: test_multiple_path_r (tasks.cephfs.test_admin.TestFsAuthorize) [7531312] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} ----------------------------------------------------------------- time: 00:53:58 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531312/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531312/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d48247917a8a446d82dd7e804df911eb Command failed (workunit test suites/dbench.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c102f04727ad86d83e0ca9348b7b0596f339d20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' [7531313] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:37:37 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531313/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531313/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94ec5c92e21f482497b2e72885dc6de5 Command failed (workunit test suites/ffsb.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c102f04727ad86d83e0ca9348b7b0596f339d20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' [7531314] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} ----------------------------------------------------------------- time: 00:10:24 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531314/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ece63a00744a44b09661fda2c81a5412 Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) [7531315] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 01:27:09 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531315/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531315/ valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions [7531316] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} ----------------------------------------------------------------- time: 00:53:24 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531316/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4479b22341c04b9da316ed0ca7afa782 Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) [7531317] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:14:47 info: https://pulpito.ceph.com/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531317/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-25_09:51:10-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7531317/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d7e22ca0c763443abee45280e82623d8 Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)