2022-01-05T14:35:56.196 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-05T14:35:56.198 INFO:teuthology.results:seed: '1031' 2022-01-05T15:26:30.100 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-05T15:26:30.144 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-05T17:57:41.671 INFO:teuthology.results:Tests finished! gathering results... 2022-01-05T17:57:46.860 INFO:scrape:Found 50 jobs 2022-01-05T17:57:48.910 INFO:scrape:Found 3 distinct failure reasons 2022-01-05T17:57:48.911 INFO:scrape:Failure: Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi068 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=761d2b270dedb00df38c861e2961c09df5681453 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' 2022-01-05T17:57:48.912 INFO:scrape:2 jobs: ['6596373', '6596398'] 2022-01-05T17:57:48.912 INFO:scrape:suites intersection: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{begin', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}', 'wsync/{no}}'] 2022-01-05T17:57:48.913 INFO:scrape:suites union: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'distro/{centos_8}', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'ms_mode/{secure}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag', 'ranks/1', 'ranks/3', 'rhel_8}', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}', 'wsync/{no}}'] 2022-01-05T17:57:48.913 INFO:scrape: 2022-01-05T17:57:48.914 INFO:scrape:Failure: Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:761d2b270dedb00df38c861e2961c09df5681453 pull' 2022-01-05T17:57:48.914 INFO:scrape:1 jobs: ['6596353'] 2022-01-05T17:57:48.915 INFO:scrape:suites: ['1-mount', '2-workload/dbench', 'distro/centos_latest}', 'fs/cephadm/multivolume/{0-start'] 2022-01-05T17:57:48.915 INFO:scrape: 2022-01-05T17:57:48.916 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2022-01-05T17:57:48.916 INFO:scrape:1 jobs: ['6596369'] 2022-01-05T17:57:48.917 INFO:scrape:suites: ['centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2022-01-05T17:57:48.917 INFO:scrape: 2022-01-05T17:57:48.920 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 46 Fail ================================================================= [6596353] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} ----------------------------------------------------------------- time: 00:10:07 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596353/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596353/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d79eb0a634e848e78dd960d94847bc26 Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:761d2b270dedb00df38c861e2961c09df5681453 pull' [6596369] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 01:19:11 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596369/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596369/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ffbe6cf322c54d4dadc2ab3fdd13fd3c Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) [6596373] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} ----------------------------------------------------------------- time: 00:25:14 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596373/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596373/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65838c21a41f458bba14b6ba328474d8 Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi068 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=761d2b270dedb00df38c861e2961c09df5681453 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' [6596398] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} ----------------------------------------------------------------- time: 00:23:28 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596398/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68ef0769811b4360b5f0398afe7b0526 Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi055 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=761d2b270dedb00df38c861e2961c09df5681453 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/fs/misc/layout_vxattrs.sh' Pass ================================================================= [6596351] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:13:37 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596351/ [6596352] fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} time: 00:12:41 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596352/ [6596354] fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore/bluestore-bitmap overrides overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} time: 00:13:46 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596354/ [6596355] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} time: 00:15:59 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596355/ [6596356] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:14:15 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596356/ [6596357] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8.stream} tasks/mirror} time: 01:54:04 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596357/ [6596358] fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit} time: 00:24:33 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596358/ [6596359] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:43:28 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596359/ [6596360] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:19:06 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596360/ [6596361] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:52:48 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596361/ [6596362] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:10:39 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596362/ [6596363] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} time: 00:33:54 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596363/ [6596364] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:47:41 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596364/ [6596365] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 00:59:10 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596365/ [6596366] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{centos_8.stream} tasks/fstop} time: 00:09:08 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596366/ [6596367] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:19:16 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596367/ [6596368] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:28:24 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596368/ [6596370] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/lockdep} time: 00:46:44 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596370/ [6596371] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:48:12 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596371/ [6596372] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} time: 00:14:17 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596372/ [6596374] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 00:51:05 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596374/ [6596375] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} time: 00:35:40 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596375/ [6596376] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:54:46 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596376/ [6596377] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} time: 00:21:48 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596377/ [6596378] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}} time: 00:53:08 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596378/ [6596379] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:23:21 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596379/ [6596380] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} time: 00:55:45 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596380/ [6596381] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:13:22 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596381/ [6596382] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}} time: 00:15:49 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596382/ [6596383] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} time: 00:18:21 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596383/ [6596384] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:12:25 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596384/ [6596385] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} time: 00:24:45 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596385/ [6596386] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:19:28 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596386/ [6596387] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} time: 00:16:45 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596387/ [6596388] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:49:53 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596388/ [6596389] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}} time: 00:24:21 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596389/ [6596390] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 02:35:52 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596390/ [6596391] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} time: 00:56:48 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596391/ [6596392] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:46:13 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596392/ [6596393] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}} time: 00:16:12 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596393/ [6596394] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}} time: 00:17:53 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596394/ [6596395] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:14:32 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596395/ [6596396] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} time: 00:15:15 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596396/ [6596397] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:16:01 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596397/ [6596399] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}} time: 01:22:23 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596399/ [6596400] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:17:39 info: http://pulpito.ceph.com/mchangir-2022-01-05_14:35:38-fs-wip-mchangir-mds-implement-new-getvxattr-rpc-distro-default-smithi/6596400/