2022-04-22T11:49:49.465 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b 2022-04-22T11:49:49.466 INFO:teuthology.results:subset: '15/32' 2022-04-22T11:49:49.466 INFO:teuthology.results:seed: '9111' 2022-04-22T12:04:02.494 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b 2022-04-22T12:04:02.503 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-22T18:32:30.537 INFO:teuthology.results:Tests finished! gathering results... 2022-04-22T18:32:36.243 INFO:scrape:Found 59 jobs 2022-04-22T18:32:41.243 INFO:scrape:Found 6 distinct failure reasons 2022-04-22T18:32:41.244 INFO:scrape:Failure: Command failed on smithi107 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2022-04-22T18:32:41.244 INFO:scrape:35 jobs 2022-04-22T18:32:41.245 INFO:scrape:suites intersection: ['2-logrotate}'] 2022-04-22T18:32:41.246 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '2-logrotate}', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/ffsb}}', '2-workunit/fs/snaps}}', '2-workunit/fs/trivial_sync}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/pjd}}', 'begin/{0-install', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'conf/{client', 'debug', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/valgrind/{begin/{0-install', 'fs/verify/{begin/{0-install', 'fs/workload/{0-rhel_8', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'ms_mode/{legacy}', 'ms_mode/{secure}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/whitelist_health', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'overrides/{mon-debug', 'overrides/{no_client_pidfile', 'overrides/{whitelist_health', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'rhel_8}', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/cfuse_workunit_misc}', 'tasks/client-readahead}', 'tasks/fsstress', 'tasks/mirror}}', 'tasks/multimds_misc}', 'tasks/pool-perm}', 'tasks/recovery-fs}', 'tasks/snap-schedule}', 'tasks/strays}', 'tasks/{0-check-counter', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'thrashosds-health', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/kernel_untar_build}', 'workunit/suites/dbench}', 'workunit/suites/ffsb}', 'wsync/{no}}', 'wsync/{yes}}'] 2022-04-22T18:32:41.246 INFO:scrape: 2022-04-22T18:32:41.246 INFO:scrape:Failure: Command failed on smithi124 with status 1: 'sudo yum -y install cephfs-java' 2022-04-22T18:32:41.247 INFO:scrape:10 jobs: ['6800179', '6800171', '6800200', '6800164', '6800184', '6800190', '6800210', '6800175', '6800214', '6800196'] 2022-04-22T18:32:41.247 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.247 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.247 INFO:scrape: 2022-04-22T18:32:41.247 INFO:scrape:Dead: b'2022-04-22T18:29:46.215 DEBUG:teuthology.exit:Finished running handlers' 2022-04-22T18:32:41.248 INFO:scrape:1 jobs: ['6800205'] 2022-04-22T18:32:41.248 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/pacific', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.248 INFO:scrape: 2022-04-22T18:32:41.248 INFO:scrape:Failure: Command failed on smithi080 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph-fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python-ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs-jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd-fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs-shell=17.0.0-11699-g4d9e7ea1-1focal cephfs-top=17.0.0-11699-g4d9e7ea1-1focal cephfs-mirror=17.0.0-11699-g4d9e7ea1-1focal' 2022-04-22T18:32:41.249 INFO:scrape:5 jobs: ['6800211', '6800180', '6800173', '6800159', '6800206'] 2022-04-22T18:32:41.249 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.249 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', '2-workunit/suites/pjd}}', 'clusters/1-mds-1-client-coloc', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'fs/shell/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'overrides/{no_client_pidfile', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'session_timeout', 'tasks/cephfs-shell}', 'tasks/snap-schedule}', 'tasks/volumes/{overrides', 'tasks/{1-thrash/mds', 'test/basic}}', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.249 INFO:scrape: 2022-04-22T18:32:41.250 INFO:scrape:Failure: The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'} 2022-04-22T18:32:41.250 INFO:scrape:1 jobs: ['6800191'] 2022-04-22T18:32:41.250 INFO:scrape:suites: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'mds', 'mon', 'mount/fuse', 'ms_mode/{secure}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag', 'ranks/5', 'scrub/no', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}', 'wsync/{no}}'] 2022-04-22T18:32:41.250 INFO:scrape: 2022-04-22T18:32:41.251 INFO:scrape:Failure: No module named 'tasks' 2022-04-22T18:32:41.251 INFO:scrape:1 jobs: ['6800215'] 2022-04-22T18:32:41.251 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/workloads/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/3', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-22T18:32:41.251 INFO:scrape: 2022-04-22T18:32:41.256 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/ failed: 52 dead: 1 running: 0 waiting: 0 queued: 0 passed: 6 Fail ================================================================= [6800157] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800157/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd07c80cb5814c0894f47844cc043296 Command failed on smithi081 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800158] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800158/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e90091a4ed949b1ad51e913a591e76e Command failed on smithi148 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800159] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} ----------------------------------------------------------------- time: 00:04:47 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800159/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bd15ff5b64846d8a50b3d925798ed04 Command failed on smithi059 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph- fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python- ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs- jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd- fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs- shell=17.0.0-11699-g4d9e7ea1-1focal cephfs- top=17.0.0-11699-g4d9e7ea1-1focal cephfs- mirror=17.0.0-11699-g4d9e7ea1-1focal' [6800160] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 00:06:16 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800160/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=632f40fe639d42f28699adccc096ec1f Command failed on smithi090 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse ceph-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800161] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800161/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a796ef89e6d94ff79f7cccdfcdfa122c Command failed on smithi141 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800162] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800162/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800162/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb1d4416e0a84a2c88c0c8274707ed04 Command failed on smithi183 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800163] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/recovery-fs} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800163/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=baf58b6214a4452f9dbed30055bf3d4e Command failed on smithi171 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800164] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:58 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800164/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b90ee5c422fb4f25a5757bb1729edb27 Command failed on smithi143 with status 1: 'sudo yum -y install cephfs- java' [6800165] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800165/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84c7dcf151cc4aa49389a297d7004a76 Command failed on smithi188 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800166] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800166/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=169930cfcf38475caf759d9a967980d6 Command failed on smithi123 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800167] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:06:03 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800167/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=190e56f7a1684dcbaeec51d8ba263c17 Command failed on smithi089 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800168] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800168/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800168/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a87e356efaec4db19cbe074d0dbc659b Command failed on smithi085 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800169] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800169/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3d40515780847d9b983c0c88c7ba62c Command failed on smithi152 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800170] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800170/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=971879faf14347f18a74172420cce77c Command failed on smithi176 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800171] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:03 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800171/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd407bedc71e4cdeb2303db29a7fa449 Command failed on smithi156 with status 1: 'sudo yum -y install cephfs- java' [6800172] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:06:12 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800172/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dff4e7534c244954b0e44b753ecd20fa Command failed on smithi136 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800173] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800173/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef9dcbd81a6d460f8a5c315349261446 Command failed on smithi083 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph- fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python- ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs- jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd- fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs- shell=17.0.0-11699-g4d9e7ea1-1focal cephfs- top=17.0.0-11699-g4d9e7ea1-1focal cephfs- mirror=17.0.0-11699-g4d9e7ea1-1focal' [6800174] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800174/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800174/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f84ba5729dfa4dca989d654924945ab1 Command failed on smithi135 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800175] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800175/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8454df7781a24574a179d0cc2580b21c Command failed on smithi159 with status 1: 'sudo yum -y install cephfs- java' [6800177] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800177/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=270c9b8925de459bba463c5ce80e61f2 Command failed on smithi149 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800178] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800178/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800178/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44960463c95a424c8ad644f4b81ef4bf Command failed on smithi190 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800179] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800179/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800179/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6dd4a0c2d5e94eb094b447cc96f79d97 Command failed on smithi124 with status 1: 'sudo yum -y install cephfs- java' [6800180] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800180/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800180/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cce5aaf4a3c496d9c0376c5a0f07150 Command failed on smithi197 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph- fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python- ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs- jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd- fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs- shell=17.0.0-11699-g4d9e7ea1-1focal cephfs- top=17.0.0-11699-g4d9e7ea1-1focal cephfs- mirror=17.0.0-11699-g4d9e7ea1-1focal' [6800181] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800181/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800181/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f09c88bb32d4afe81c3c37d115895b2 Command failed on smithi160 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800182] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800182/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800182/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a019437dae442269130fb2738486132 Command failed on smithi145 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800183] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800183/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800183/ sentry: https://sentry.ceph.com/organizations/ceph/?query=647139dfc1b344e381eb0f14d50399d8 Command failed on smithi174 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800184] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800184/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800184/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f2853be093c4dc3b5e7fd862f67cf4c Command failed on smithi129 with status 1: 'sudo yum -y install cephfs- java' [6800185] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800185/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caee728183d94e799570bfb1dc03fc17 Command failed on smithi053 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800186] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800186/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800186/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd1ed257674d4c72a3c1552cca4c2f9e Command failed on smithi167 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800187] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800187/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbfd2ef98bc64c268d845b08743128f2 Command failed on smithi133 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800188] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800188/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da60d7f15b2c404bb05e7fac749856f4 Command failed on smithi191 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800190] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800190/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e609cf1844d4c6b8f8d21b1272c91b0 Command failed on smithi101 with status 1: 'sudo yum -y install cephfs- java' [6800191] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} ----------------------------------------------------------------- time: 01:03:17 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800191/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800191/ The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'} [6800192] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800192/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f427cd883fc34217a282c22daa434550 Command failed on smithi157 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800194] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800194/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91f3c7b9cc924ba1ab33d6f71bf859fd Command failed on smithi109 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800195] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800195/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07357404dc254c54894e3b2a62d97019 Command failed on smithi016 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800196] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800196/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6ff90db08f6457cb9c8130777069493 Command failed on smithi052 with status 1: 'sudo yum -y install cephfs- java' [6800197] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} ----------------------------------------------------------------- time: 00:08:12 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800197/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21ecaaa54eec425e8f573e8b05211f52 Command failed on smithi093 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800198] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800198/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a347991c607047f6808e677062403632 Command failed on smithi064 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse ceph-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800200] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:52 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800200/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c39a6d9a4c59422f9deb3bb12a1b9e5d Command failed on smithi084 with status 1: 'sudo yum -y install cephfs- java' [6800201] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc} ----------------------------------------------------------------- time: 00:05:53 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800201/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800201/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be240ad6ee0946cd8ea062393e640940 Command failed on smithi142 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800202] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800202/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800202/ sentry: https://sentry.ceph.com/organizations/ceph/?query=237a756d6090450cbac8f1acebf716ee Command failed on smithi119 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800203] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} ----------------------------------------------------------------- time: 00:06:20 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800203/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ec866f1874d4860abe2f474f047273c Command failed on smithi154 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800204] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800204/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ad0982271b34cc39d629721f53af381 Command failed on smithi155 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800206] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:04:53 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800206/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800206/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8499c63f05f04ca39ffa13373ccf7edf Command failed on smithi007 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph- fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python- ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs- jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd- fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs- shell=17.0.0-11699-g4d9e7ea1-1focal cephfs- top=17.0.0-11699-g4d9e7ea1-1focal cephfs- mirror=17.0.0-11699-g4d9e7ea1-1focal' [6800208] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800208/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c7c9e55d9d8488b9b93a929924c0388 Command failed on smithi107 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800209] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800209/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=040934d4c81d46df8cb894608d808bd0 Command failed on smithi071 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800210] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800210/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db8c09e75eb0447bbd704a3454c9a32c Command failed on smithi097 with status 1: 'sudo yum -y install cephfs- java' [6800211] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:04:44 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800211/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800211/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ccdc81f6370468785ba0e58450dbf3a Command failed on smithi080 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11699-g4d9e7ea1-1focal ceph-mds=17.0.0-11699-g4d9e7ea1-1focal ceph-common=17.0.0-11699-g4d9e7ea1-1focal ceph- fuse=17.0.0-11699-g4d9e7ea1-1focal ceph-test=17.0.0-11699-g4d9e7ea1-1focal radosgw=17.0.0-11699-g4d9e7ea1-1focal python- ceph=17.0.0-11699-g4d9e7ea1-1focal libcephfs1=17.0.0-11699-g4d9e7ea1-1focal libcephfs-java=17.0.0-11699-g4d9e7ea1-1focal libcephfs- jni=17.0.0-11699-g4d9e7ea1-1focal librados2=17.0.0-11699-g4d9e7ea1-1focal librbd1=17.0.0-11699-g4d9e7ea1-1focal rbd- fuse=17.0.0-11699-g4d9e7ea1-1focal python3-cephfs=17.0.0-11699-g4d9e7ea1-1focal cephfs- shell=17.0.0-11699-g4d9e7ea1-1focal cephfs- top=17.0.0-11699-g4d9e7ea1-1focal cephfs- mirror=17.0.0-11699-g4d9e7ea1-1focal' [6800213] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800213/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f28da57249f466ab088717837eb0e68 Command failed on smithi178 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' [6800214] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800214/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7890226c0c5d4f5d8260d94c01b79ae9 Command failed on smithi187 with status 1: 'sudo yum -y install cephfs- java' [6800215] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800215/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97dd3d3cce9c442da6c4a483d733dcf0 No module named 'tasks' Dead ================================================================= [6800205] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800205/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800205/ hit max job timeout Pass ================================================================= [6800176] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:13:07 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800176/ [6800189] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:18:31 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800189/ [6800193] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} time: 01:12:23 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800193/ [6800199] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:24:57 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800199/ [6800207] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:27:38 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800207/ [6800212] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:18:17 info: http://pulpito.ceph.com/vshankar-2022-04-22_11:49:41-fs-wip-vshankar-testing1-20220419-121051-testing-default-smithi/6800212/