2023-05-04T01:02:57.773 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-04T01:02:57.774 INFO:teuthology.results:subset: '111/12000' 2023-05-04T01:02:57.775 INFO:teuthology.results:seed: '2155' 2023-05-04T01:10:55.339 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-04T01:10:55.373 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-05-04T08:11:26.004 INFO:teuthology.results:Tests finished! gathering results... 2023-05-04T08:11:27.040 INFO:scrape:Found 12 jobs 2023-05-04T08:11:30.065 INFO:scrape:Found 5 distinct failure reasons 2023-05-04T08:11:30.066 INFO:scrape:Failure: Command failed on smithi186 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2023-05-04T08:11:30.066 INFO:scrape:5 jobs: ['7261873', '7261872', '7261876', '7261881', '7261871'] 2023-05-04T08:11:30.066 INFO:scrape:suites intersection: [] 2023-05-04T08:11:30.067 INFO:scrape:suites union: ['2-workunit/suites/fsstress}}', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'debug', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/mirror/{begin', 'fs/thrash/workloads/{begin', 'fs/valgrind/{begin', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'k-testing}', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/whitelist_health', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'overrides/{ignorelist_health', 'overrides/{whitelist_health}', 'prefetch_dirfrags/no', 'races', 'ranks/5', 'session_timeout', 'supported-random-distros$/{centos_8}', 'tasks/mds-full}', 'tasks/mirror}', 'tasks/mirror}}', 'tasks/snap-schedule}', 'tasks/{1-thrash/mon', 'thrashosds-health}'] 2023-05-04T08:11:30.067 INFO:scrape: 2023-05-04T08:11:30.067 INFO:scrape:Failure: "2023-05-04T01:40:49.812432+0000 mon.a (mon.0) 1634 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2023-05-04T08:11:30.068 INFO:scrape:1 jobs: ['7261878'] 2023-05-04T08:11:30.068 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/metrics}'] 2023-05-04T08:11:30.068 INFO:scrape: 2023-05-04T08:11:30.068 INFO:scrape:Failure: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-05-04T08:11:30.069 INFO:scrape:1 jobs: ['7261874'] 2023-05-04T08:11:30.069 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/acls}'] 2023-05-04T08:11:30.069 INFO:scrape: 2023-05-04T08:11:30.070 INFO:scrape:Failure: "2023-05-04T02:16:32.440224+0000 mds.a (mds.0) 1 : cluster [WRN] client.4533 isn't responding to mclientcaps(revoke), ino 0x1000000324d pending pAsLsXsFsx issued pAsLsXsFsxr, sent 303.981529 seconds ago" in cluster log 2023-05-04T08:11:30.070 INFO:scrape:1 jobs: ['7261877'] 2023-05-04T08:11:30.070 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'session_timeout}', 'tasks/fsstress', 'validater/valgrind}'] 2023-05-04T08:11:30.071 INFO:scrape: 2023-05-04T08:11:30.071 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/suites/fsstress.sh 2023-05-04T08:11:30.071 INFO:scrape:1 jobs: ['7261880'] 2023-05-04T08:11:30.071 INFO:scrape:suites: ['2-workunit/suites/fsstress}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'prefetch_dirfrags/no', 'races', 'ranks/5', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health}'] 2023-05-04T08:11:30.072 INFO:scrape: 2023-05-04T08:11:30.073 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/ failed: 9 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [7261871] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261871/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261871/ sentry: https://sentry.ceph.com/organizations/ceph/?query=852664755046425cac9134ed508aea40 Command failed on smithi082 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils- libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [7261872] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror} ----------------------------------------------------------------- time: 00:09:28 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261872/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261872/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98ed04395d0741c39d0a7bd4f6a38434 Command failed on smithi102 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils- libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [7261873] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 00:09:45 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261873/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261873/ sentry: https://sentry.ceph.com/organizations/ceph/?query=169f3354ae6f4c759df55abd108ddde2 Command failed on smithi186 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable- object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph- base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs- debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw- debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [7261874] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261874/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261874/ sentry: https://sentry.ceph.com/organizations/ceph/?query=415047fda62143f28ec33284298d231a Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) [7261876] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} ----------------------------------------------------------------- time: 00:09:31 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261876/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c3ef00ce6574a4b9430e2b34060a633 Command failed on smithi178 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils- libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [7261877] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 01:40:48 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261877/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261877/ "2023-05-04T02:16:32.440224+0000 mds.a (mds.0) 1 : cluster [WRN] client.4533 isn't responding to mclientcaps(revoke), ino 0x1000000324d pending pAsLsXsFsx issued pAsLsXsFsxr, sent 303.981529 seconds ago" in cluster log [7261878] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:35:43 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261878/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261878/ "2023-05-04T01:40:49.812432+0000 mon.a (mon.0) 1634 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [7261880] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 06:56:55 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261880/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=951d7664d15b4e868c4f080d02d03841 Command failed (workunit test suites/fsstress.sh) on smithi101 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=766a5b617098839eab08df9bed88d9daf5be46b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh' [7261881] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261881/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261881/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6910368126684017bf9f377b8c8fabf4 Command failed on smithi078 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils- libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs- devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util- linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' Pass ================================================================= [7261875] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:22:31 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261875/ [7261879] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:44 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261879/ [7261882] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:35:48 info: http://pulpito.ceph.com/vshankar-2023-05-04_01:02:25-fs-pacific-release-testing-default-smithi/7261882/