2022-08-31T18:11:59.656 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-08-31T18:11:59.660 INFO:teuthology.results:subset: '111/120000'
2022-08-31T18:11:59.660 INFO:teuthology.results:seed: '2142'
2022-08-31T22:17:05.142 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-08-31T22:17:05.180 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-08-31T23:58:15.145 INFO:teuthology.results:Tests finished! gathering results...
2022-08-31T23:58:34.335 INFO:scrape:Found 184 jobs
2022-08-31T23:58:57.417 INFO:scrape:Found 12 distinct failure reasons
2022-08-31T23:58:57.419 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_info_if_orphan_clone (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)
2022-08-31T23:58:57.419 INFO:scrape:1 jobs: ['7002885']
2022-08-31T23:58:57.420 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}']
2022-08-31T23:58:57.420 INFO:scrape:
2022-08-31T23:58:57.421 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2022-08-31T23:58:57.422 INFO:scrape:3 jobs: ['7003165', '7002988', '7003141']
2022-08-31T23:58:57.423 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'msgr-failures/osd-mds-delay', 'osd}', 'overrides/{frag', 'session_timeout', 'thrashosds-health}']
2022-08-31T23:58:57.424 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/fs/trivial_sync}}', '2-workunit/suites/pjd}}', 'clusters/1a3s-mds-2c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/no', 'races', 'ranks/1', 'ranks/5', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'thrashosds-health}']
2022-08-31T23:58:57.425 INFO:scrape:
2022-08-31T23:58:57.426 INFO:scrape:Failure: "1661982835.6973422 mon.a (mon.0) 217 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-08-31T23:58:57.427 INFO:scrape:6 jobs: ['7003104', '7002881', '7002817', '7003056', '7003151', '7003119']
2022-08-31T23:58:57.427 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2022-08-31T23:58:57.428 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu/{latest', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'tasks/failover}', 'tasks/metrics}', 'tasks/snap-schedule}', 'tasks/strays}', 'validater/valgrind}']
2022-08-31T23:58:57.429 INFO:scrape:
2022-08-31T23:58:57.430 INFO:scrape:Failure: Command failed (workunit test suites/pjd.sh) on smithi105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh'
2022-08-31T23:58:57.431 INFO:scrape:1 jobs: ['7003167']
2022-08-31T23:58:57.431 INFO:scrape:suites: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'ranks/multi/{export-check', 'replication/default}', 'rhel_8}', 'scrub/no', 'session_timeout}', 'standby-replay', 'subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-check-counter', 'workunit/suites/pjd}}', 'wsync/no}']
2022-08-31T23:58:57.432 INFO:scrape:
2022-08-31T23:58:57.433 INFO:scrape:Failure: Test failure: test_subvolume_group_ls_filter_internal_directories (tasks.cephfs.test_volumes.TestSubvolumeGroups)
2022-08-31T23:58:57.433 INFO:scrape:2 jobs: ['7003074', '7002829']
2022-08-31T23:58:57.434 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/basic}}']
2022-08-31T23:58:57.434 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/volumes/{overrides', 'test/basic}}']
2022-08-31T23:58:57.435 INFO:scrape:
2022-08-31T23:58:57.436 INFO:scrape:Failure: Command failed on smithi137 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5fbad64-2963-11ed-8431-001a4aab830c -- ceph orch daemon add osd smithi137:vg_nvme/lv_4'
2022-08-31T23:58:57.436 INFO:scrape:1 jobs: ['7002909']
2022-08-31T23:58:57.437 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific']
2022-08-31T23:58:57.438 INFO:scrape:
2022-08-31T23:58:57.439 INFO:scrape:Failure: Test failure: test_dump_loads (tasks.cephfs.test_admin.TestAdminCommandDumpLoads)
2022-08-31T23:58:57.440 INFO:scrape:1 jobs: ['7002891']
2022-08-31T23:58:57.440 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/admin}']
2022-08-31T23:58:57.441 INFO:scrape:
2022-08-31T23:58:57.442 INFO:scrape:Failure: {'smithi109.front.sepia.ceph.com': {'_ansible_no_log': False, 'cache_update_time': 1661974848, 'cache_updated': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'python-dev', 'libfcgi0ldbl', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'only_upgrade': False, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'python-dev', 'libfcgi0ldbl', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': None, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold"   --force-yes   install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 15414 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 15414 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 15414 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}
2022-08-31T23:58:57.442 INFO:scrape:1 jobs: ['7002936']
2022-08-31T23:58:57.443 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/client-limits}']
2022-08-31T23:58:57.444 INFO:scrape:
2022-08-31T23:58:57.444 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_clone_quota_exceeded (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)
2022-08-31T23:58:57.445 INFO:scrape:1 jobs: ['7003138']
2022-08-31T23:58:57.445 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}']
2022-08-31T23:58:57.445 INFO:scrape:
2022-08-31T23:58:57.446 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh'
2022-08-31T23:58:57.446 INFO:scrape:1 jobs: ['7003136']
2022-08-31T23:58:57.447 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/snaps/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/snaps}']
2022-08-31T23:58:57.447 INFO:scrape:
2022-08-31T23:58:57.448 INFO:scrape:Failure: Command failed (workunit test kernel_untar_build.sh) on smithi189 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'
2022-08-31T23:58:57.448 INFO:scrape:1 jobs: ['7003153']
2022-08-31T23:58:57.449 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}']
2022-08-31T23:58:57.449 INFO:scrape:
2022-08-31T23:58:57.450 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54
2022-08-31T23:58:57.450 INFO:scrape:1 jobs: ['7003018']
2022-08-31T23:58:57.450 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}']
2022-08-31T23:58:57.451 INFO:scrape:
2022-08-31T23:58:57.464 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/
failed:  19
dead:    1
running: 0
waiting: 0
queued:  0
passed:  164


Fail
=================================================================
[7002817]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:48:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002817/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002817/

    "1661970668.1675386 mon.a (mon.0) 496 : cluster [WRN] Health check failed:
    Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY)"
    in cluster log

[7002829]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:31:52
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002829/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002829/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9451fa3e12a34b45be30787aec6a4e89

    Test failure: test_subvolume_group_ls_filter_internal_directories
    (tasks.cephfs.test_volumes.TestSubvolumeGroups)

[7002881]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
-----------------------------------------------------------------
time:   00:58:23
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002881/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002881/

    "1661975600.0767207 mon.a (mon.0) 3532 : cluster [WRN] Health check failed:
    Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

[7002885]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   01:02:15
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002885/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002885/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4989f8657e334bccbddcbc5f0555201f

    Test failure: test_subvolume_snapshot_info_if_orphan_clone
    (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

[7002891]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin}
-----------------------------------------------------------------
time:   00:14:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002891/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002891/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4e2029d31bd34f9aa8b795c1c1bff258

    Test failure: test_dump_loads
    (tasks.cephfs.test_admin.TestAdminCommandDumpLoads)

[7002909]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:12:19
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002909/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002909/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1336c40b9d61450787b48850221a4303

    Command failed on smithi137 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/daemon-base:latest-
    pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring
    --fsid d5fbad64-2963-11ed-8431-001a4aab830c -- ceph orch daemon add osd
    smithi137:vg_nvme/lv_4'

[7002988]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:22:52
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002988/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002988/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08237f0c323147fd905630edf3de66d6

    reached maximum tries (90) after waiting for 540 seconds

[7003018]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:06:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003018/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003018/
sentry: https://sentry.ceph.com/organizations/ceph/?query=22c8efd1e2434dea9c4b9a0a6bb38186

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1
    =4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54

[7003056]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics}
-----------------------------------------------------------------
time:   00:29:41
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003056/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003056/

    "1661980885.938933 mon.a (mon.0) 2154 : cluster [WRN] Health check failed:
    Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)"
    in cluster log

[7003074]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:40:46
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003074/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003074/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c84213e29afb4f1ba6a3b6deaf8529e2

    Test failure: test_subvolume_group_ls_filter_internal_directories
    (tasks.cephfs.test_volumes.TestSubvolumeGroups)

[7003104]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:51:58
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003104/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003104/

    "1661982835.6973422 mon.a (mon.0) 217 : cluster [WRN] Health check failed:
    Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded
    (PG_DEGRADED)" in cluster log

[7003119]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:54:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003119/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003119/

    "1661983297.4523337 mon.a (mon.0) 334 : cluster [WRN] Health check failed:
    Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

[7003136]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:38:06
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003136/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003136/
sentry: https://sentry.ceph.com/organizations/ceph/?query=11c5e3f17b8248c9bdf7dab35784e8a5

    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on
    smithi156 with status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-
    multiple-capsnaps.sh'

[7003138]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:45:35
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003138/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003138/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ae682bbc86d248eabe2dd0c288e45616

    Test failure: test_subvolume_snapshot_clone_quota_exceeded
    (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

[7003141]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   00:21:42
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003141/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003141/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f5fd054e9a184c0cb75a850f20e9507d

    reached maximum tries (90) after waiting for 540 seconds

[7003151]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
-----------------------------------------------------------------
time:   00:34:54
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003151/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003151/

    "1661985137.6462696 mon.a (mon.0) 1487 : cluster [WRN] Health check failed:
    Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)"
    in cluster log

[7003153]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:29:51
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003153/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003153/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b993cf4d4aba49b0bae73cecbf8f7c4e

    Command failed (workunit test kernel_untar_build.sh) on smithi189 with
    status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

[7003165]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:19:36
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003165/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003165/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2f530ecc61c4630ba2c3cc786ff2201

    reached maximum tries (90) after waiting for 540 seconds

[7003167]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/no standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:28:34
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003167/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ef92f087afd74684ba53522ab7096024

    Command failed (workunit test suites/pjd.sh) on smithi105 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4ab2d4e1d3292e01a3c9dec0d93cbe9c8ccc1e54
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh'



Dead
=================================================================
[7002936]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits}
-----------------------------------------------------------------
time:   00:05:57
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002936/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002936/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a01bf38e7b3a45b4ad104b2885a95fd3

    {'smithi109.front.sepia.ceph.com': {'_ansible_no_log': False,
    'cache_update_time': 1661974848, 'cache_updated': False, 'changed': False,
    'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean':
    False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None,
    'default_release': None, 'dpkg_options': 'force-confdef,force-confold',
    'force': True, 'force_apt_get': False, 'install_recommends': None, 'name':
    ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io',
    'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj',
    'python3-gevent', 'python3-numpy', 'python3-matplotlib',
    'python3-setuptools', 'python-dev', 'libfcgi0ldbl', 'libev-dev', 'perl',
    'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb',
    'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1',
    'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind',
    'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc',
    'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin',
    'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage',
    'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-
    iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server',
    'software-properties-common', 'libgnutls30'], 'only_upgrade': False,
    'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin',
    'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv',
    'python3-configobj', 'python3-gevent', 'python3-numpy',
    'python3-matplotlib', 'python3-setuptools', 'python-dev', 'libfcgi0ldbl',
    'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential',
    'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk',
    'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench',
    'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-
    dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev',
    'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh',
    'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-
    jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common',
    'nfs-kernel-server', 'software-properties-common', 'libgnutls30'],
    'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache':
    None, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12,
    'upgrade': None}}, 'msg': '\'/usr/bin/apt-get -y -o
    "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold"
    --force-yes   install \'qemu-system-x86\' \'git-core\'\' failed: W:
    --force-yes is deprecated, use one of the options starting with --allow
    instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by
    process 15414 (apt-get)\nE: Unable to acquire the dpkg frontend lock
    (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100,
    'stderr': 'W: --force-yes is deprecated, use one of the options starting
    with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend.
    It is held by process 15414 (apt-get)\nE: Unable to acquire the dpkg
    frontend lock (/var/lib/dpkg/lock-frontend), is another process using
    it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the
    options starting with --allow instead.', 'E: Could not get lock
    /var/lib/dpkg/lock-frontend. It is held by process 15414 (apt-get)', 'E:
    Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is
    another process using it?'], 'stdout': '', 'stdout_lines': []}}



Pass
=================================================================
[7002818] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:15:42
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002818/

[7002819] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:20:29
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002819/

[7002820] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/suites/pjd}}
time:   00:27:16
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002820/

[7002821] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
time:   00:12:49
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002821/

[7002823] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:10:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002823/

[7002825] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:26:01
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002825/

[7002827] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:39:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002827/

[7002831] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
time:   00:30:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002831/

[7002833] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:22:52
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002833/

[7002835] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:34:23
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002835/

[7002837] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
time:   00:32:58
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002837/

[7002839] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:17:19
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002839/

[7002841] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/yes standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/direct_io}}
time:   00:34:39
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002841/

[7002843] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:27:58
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002843/

[7002845] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration}
time:   00:21:55
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002845/

[7002847] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:18:33
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002847/

[7002849] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002849/

[7002851] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:14:19
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002851/

[7002853] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:21:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002853/

[7002855] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay}
time:   00:19:14
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002855/

[7002857] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:55
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002857/

[7002859] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:22:48
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002859/

[7002861] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries}
time:   00:13:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002861/

[7002863] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/no standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/fs/misc}}
time:   00:55:43
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002863/

[7002865] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}
time:   00:14:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002865/

[7002867] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:45:41
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002867/

[7002869] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:15:11
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002869/

[7002871] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:28:01
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002871/

[7002873] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:15:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002873/

[7002875] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep}
time:   00:18:30
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002875/

[7002877] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}
time:   00:21:50
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002877/

[7002879] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
time:   00:13:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002879/

[7002883] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:21:44
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002883/

[7002887] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:18:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002887/

[7002889] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002889/

[7002893] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/yes standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/kernel_untar_build}}
time:   01:06:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002893/

[7002895] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:29
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002895/

[7002897] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:15:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002897/

[7002899] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:27:06
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002899/

[7002901] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}
time:   00:14:35
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002901/

[7002903] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:21:44
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002903/

[7002905] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree}
time:   00:29:36
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002905/

[7002907] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   00:54:36
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002907/

[7002911] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair}
time:   00:14:49
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002911/

[7002913] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/no standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:36:36
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002913/

[7002916] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:24:15
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002916/

[7002918] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace}
time:   00:13:48
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002918/

[7002920] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:24:27
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002920/

[7002922] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:48:56
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002922/

[7002924] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush}
time:   00:18:12
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002924/

[7002926] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/suites/dbench}}
time:   01:42:45
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002926/

[7002928] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:34
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002928/

[7002930] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137}
time:   00:13:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002930/

[7002932] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host}
time:   00:49:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002932/

[7002934] fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full}
time:   00:19:31
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002934/

[7002938] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client}
time:   00:13:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002938/

[7002940] fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror}
time:   01:58:57
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002940/

[7002942] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit}
time:   00:22:23
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002942/

[7002944] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:44:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002944/

[7002946] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:55:05
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002946/

[7002948] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:29:32
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002948/

[7002950] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:15:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002950/

[7002952] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell}
time:   00:41:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002952/

[7002954] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:05:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002954/

[7002956] fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{centos_8} tasks/fstop}
time:   00:10:50
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002956/

[7002958] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:22:29
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002958/

[7002960] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:26:04
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002960/

[7002962] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
time:   02:07:18
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002962/

[7002964] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:21:34
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002964/

[7002966] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   02:03:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002966/

[7002968] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002968/

[7002970] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}
time:   00:52:47
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002970/

[7002972] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:19:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002972/

[7002974] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:53
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002974/

[7002976] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}
time:   00:41:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002976/

[7002978] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/no standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/ffsb}}
time:   01:00:45
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002978/

[7002980] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:21:54
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002980/

[7002982] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage}
time:   00:21:00
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002982/

[7002984] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002984/

[7002986] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}
time:   00:30:04
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002986/

[7002990] fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}}
time:   00:12:59
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002990/

[7002992] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports}
time:   00:52:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002992/

[7002994] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:14:22
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002994/

[7002996] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002996/

[7002998] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:18:59
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7002998/

[7003000] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/yes standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/fs/norstats}}
time:   00:35:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003000/

[7003002] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
time:   00:18:19
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003002/

[7003004] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:20:48
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003004/

[7003006] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:19:22
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003006/

[7003008] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment}
time:   00:20:25
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003008/

[7003010] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:12:58
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003010/

[7003012] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
time:   01:05:46
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003012/

[7003014] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:03:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003014/

[7003016] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:31:34
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003016/

[7003020] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   01:01:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003020/

[7003022] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:50
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003022/

[7003024] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:22:11
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003024/

[7003026] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair}
time:   00:24:27
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003026/

[7003028] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/no standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:33:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003028/

[7003030] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush}
time:   00:10:41
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003030/

[7003032] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:16:31
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003032/

[7003034] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:25:45
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003034/

[7003036] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep}
time:   00:19:59
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003036/

[7003038] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}
time:   00:23:54
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003038/

[7003040] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003040/

[7003042] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb}
time:   00:14:19
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003042/

[7003044] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:13:39
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003044/

[7003046] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:36:50
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003046/

[7003048] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry}
time:   00:17:13
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003048/

[7003050] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:34:03
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003050/

[7003052] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/yes standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/suites/fsx}}
time:   00:45:27
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003052/

[7003054] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   00:56:47
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003054/

[7003058] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:27:55
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003058/

[7003060] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc}
time:   00:19:20
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003060/

[7003062] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:16:58
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003062/

[7003064] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:25:54
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003064/

[7003066] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable}
time:   00:16:38
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003066/

[7003068] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
time:   00:21:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003068/

[7003070] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:30:25
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003070/

[7003072] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:49:37
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003072/

[7003076] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:27
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003076/

[7003078] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:53:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003078/

[7003080] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}
time:   00:14:17
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003080/

[7003082] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:52
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003082/

[7003084] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:15:48
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003084/

[7003086] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003086/

[7003088] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   00:48:28
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003088/

[7003090] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:19:56
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003090/

[7003092] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   01:39:53
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003092/

[7003094] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}
time:   00:13:50
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003094/

[7003096] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/yes standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:43:32
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003096/

[7003098] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs}
time:   00:17:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003098/

[7003100] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:16:41
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003100/

[7003102] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:12
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003102/

[7003106] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}
time:   00:21:18
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003106/

[7003108] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:19:24
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003108/

[7003110] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:26:32
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003110/

[7003113] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}
time:   00:16:10
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003113/

[7003115] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/no standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/iogen}}
time:   00:42:05
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003115/

[7003117] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:17:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003117/

[7003121] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003121/

[7003123] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:23
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003123/

[7003125] fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health}
time:   00:18:42
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003125/

[7003127] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
time:   00:13:25
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003127/

[7003129] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003129/

[7003131] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:52:22
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003131/

[7003133] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
time:   00:57:11
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003133/

[7003135] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:31
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003135/

[7003143] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
time:   00:24:26
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003143/

[7003145] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:26:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003145/

[7003147] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/yes standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/suites/iozone}}
time:   00:36:24
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003147/

[7003149] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:19:52
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003149/

[7003155] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:17:47
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003155/

[7003157] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:11:53
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003157/

[7003159] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:18:09
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003159/

[7003161] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration}
time:   00:17:30
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003161/

[7003163] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay}
time:   00:14:32
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003163/

[7003169] fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}}
time:   00:12:43
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003169/

[7003171] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries}
time:   00:21:07
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003171/

[7003173] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind}
time:   01:37:21
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003173/

[7003175] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:57
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003175/

[7003177] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003177/

[7003179] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:45:02
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003179/

[7003181] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:27
info:   http://pulpito.ceph.com/yuriw-2022-08-31_18:07:05-fs-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003181/