2023-08-22T11:24:51.099 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-22T11:24:51.101 INFO:teuthology.results:subset: '922/1024' 2023-08-22T11:24:51.101 INFO:teuthology.results:seed: '2667' 2023-08-23T01:58:16.018 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T01:58:16.045 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-23T03:48:25.524 INFO:teuthology.results:Tests finished! gathering results... 2023-08-23T03:48:42.576 INFO:scrape:Found 197 jobs 2023-08-23T03:48:44.740 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375708/teuthology.log 2023-08-23T03:49:01.935 INFO:scrape:Found 16 distinct failure reasons 2023-08-23T03:49:01.936 INFO:scrape:Failure: Command failed (workunit test kernel_untar_build.sh) on smithi178 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2023-08-23T03:49:01.936 INFO:scrape:2 jobs: ['7375765', '7375838'] 2023-08-23T03:49:01.936 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}'] 2023-08-23T03:49:01.937 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}'] 2023-08-23T03:49:01.937 INFO:scrape: 2023-08-23T03:49:01.938 INFO:scrape:Failure: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-08-23T03:49:01.938 INFO:scrape:1 jobs: ['7375867'] 2023-08-23T03:49:01.938 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/acls}'] 2023-08-23T03:49:01.938 INFO:scrape: 2023-08-23T03:49:01.939 INFO:scrape:Failure: No module named 'tasks.cephfs.fuse_mount' 2023-08-23T03:49:01.939 INFO:scrape:10 jobs: ['7375711', '7375717', '7375693', '7375710', '7375700', '7375737', '7375738', '7375733', '7375702', '7375716'] 2023-08-23T03:49:01.939 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}'] 2023-08-23T03:49:01.940 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-check-counter', '1-client', '1-client-sanity}}}', '1-mount/mount/fuse', '1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-logrotate}', '2-scrub/yes', '2-upgrade', '2-workload/new_ops/{0-clients/fuse-upgrade', '2-workunit/cfuse_workunit_snaptests}}', '3-compat_client/no}}', '3-inline/no', '3-snaps/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-flush/no', '4-verify}', '5-upgrade-with-workload', '5-workunit/suites/iogen}}', '5-workunit/suites/pjd}}', '6-verify}}', 'begin/{0-install', 'centos_8', 'centos_8.stream_container_tools', 'clusters/1-mds-2-client-micro', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/{1-mds-1-client-micro}', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu/{latest', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'fail_fs/no', 'frag', 'fs/32bits/{begin/{0-install', 'fs/functional/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'fs/upgrade/upgraded_client/{bluestore-bitmap', 'fs/verify/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{k-testing', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/secure', 'msgr-failures/osd-mds-delay', 'multifs', 'multimds/no', 'n/3', 'no_client_pidfile}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{faked-ino', 'overrides/{frag', 'overrides/{ignorelist_health', 'overrides}}', 'pg-warn', 'pg-warn}', 'ranks/1', 'ranks/multi/{export-check', 'replication/always}', 'replication/default}', 'rhel_8}', 'roles', 'session_timeout', 'session_timeout}', 'standby-replay', 'syntax}', 'tasks/acls}', 'tasks/admin}', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/dbench', 'tasks/{0-from/pacific', 'tasks/{0-octopus', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{0-subvolume/{with-no-extra-options}', 'tasks/{1-thrash/mds', 'thrashosds-health}', 'validater/lockdep}', 'wsync/no}'] 2023-08-23T03:49:01.940 INFO:scrape: 2023-08-23T03:49:01.941 INFO:scrape:Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-23T03:49:01.941 INFO:scrape:1 jobs: ['7375814'] 2023-08-23T03:49:01.941 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/quota}'] 2023-08-23T03:49:01.942 INFO:scrape: 2023-08-23T03:49:01.942 INFO:scrape:Failure: Test failure: test_mirroring (unittest.loader._FailedTest) 2023-08-23T03:49:01.942 INFO:scrape:1 jobs: ['7375692'] 2023-08-23T03:49:01.943 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2023-08-23T03:49:01.943 INFO:scrape: 2023-08-23T03:49:01.943 INFO:scrape:Dead: b'2023-08-23T01:55:17.806 DEBUG:teuthology.exit:Finished running handlers' 2023-08-23T03:49:01.944 INFO:scrape:3 jobs: ['7375819', '7375687', '7375753'] 2023-08-23T03:49:01.944 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'osd}', 'overrides/{ignorelist_health', 'tasks/multifs-auth}'] 2023-08-23T03:49:01.944 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_20.04}', 'distro/{ubuntu_latest}', 'fs/multifs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/multifs-auth}'] 2023-08-23T03:49:01.945 INFO:scrape: 2023-08-23T03:49:01.945 INFO:scrape:Dead: None 2023-08-23T03:49:01.945 INFO:scrape:4 jobs: ['7375708', '7375729', '7375748', '7375831'] 2023-08-23T03:49:01.946 INFO:scrape: 2023-08-23T03:49:01.946 INFO:scrape:Failure: Command failed on smithi107 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-08-23T03:49:01.946 INFO:scrape:4 jobs: ['7375752', '7375848', '7375818', '7375721'] 2023-08-23T03:49:01.947 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health'] 2023-08-23T03:49:01.947 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/ior-shared-file}', 'tasks/mdtest}'] 2023-08-23T03:49:01.947 INFO:scrape: 2023-08-23T03:49:01.947 INFO:scrape:Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-23T03:49:01.948 INFO:scrape:2 jobs: ['7375861', '7375703'] 2023-08-23T03:49:01.948 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] 2023-08-23T03:49:01.948 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/xfstests-dev}'] 2023-08-23T03:49:01.949 INFO:scrape: 2023-08-23T03:49:01.949 INFO:scrape:Crash: Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh' 2023-08-23T03:49:01.949 INFO:scrape:ceph version 18.0.0-5602-g54fd6f84 (54fd6f849d61b151541bf28aca0de4ec83da7fd3) reef (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f756cc12ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f756e0abf2f] 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ac09b) [0x7f756e0ac09b] 6: (MetaSession::~MetaSession()+0x1eb) [0x55ea27488fcb] 7: (std::_Sp_counted_ptr::_M_dispose()+0x16) [0x55ea27489046] 8: (std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release()+0x3a) [0x55ea2746f92a] 9: (Client::handle_client_session(boost::intrusive_ptr const&)+0xf8) [0x55ea27450978] 10: (Client::ms_dispatch2(boost::intrusive_ptr const&)+0x555) [0x55ea274570a5] 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f756e32aed8] 12: (DispatchQueue::entry()+0x51f) [0x7f756e32805f] 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f756e3ef911] 14: /lib64/libpthread.so.0(+0x81cf) [0x7f756cc081cf] 15: clone() 2023-08-23T03:49:01.950 INFO:scrape:1 jobs: ['7375713'] 2023-08-23T03:49:01.950 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2023-08-23T03:49:01.950 INFO:scrape: 2023-08-23T03:49:01.951 INFO:scrape:Failure: Command failed (workunit test suites/ffsb.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2023-08-23T03:49:01.951 INFO:scrape:1 jobs: ['7375793'] 2023-08-23T03:49:01.951 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/ffsb}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/yes}'] 2023-08-23T03:49:01.952 INFO:scrape: 2023-08-23T03:49:01.952 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi175 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-08-23T03:49:01.952 INFO:scrape:2 jobs: ['7375865', '7375707'] 2023-08-23T03:49:01.953 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] 2023-08-23T03:49:01.953 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] 2023-08-23T03:49:01.953 INFO:scrape: 2023-08-23T03:49:01.954 INFO:scrape:Failure: "2023-08-22T13:37:03.801838+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench result of 98570.543126 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.5. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log 2023-08-23T03:49:01.954 INFO:scrape:1 jobs: ['7375782'] 2023-08-23T03:49:01.954 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/mds-full}'] 2023-08-23T03:49:01.954 INFO:scrape: 2023-08-23T03:49:01.955 INFO:scrape:Failure: Command failed (workunit test fs/test_python.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2023-08-23T03:49:01.955 INFO:scrape:1 jobs: ['7375835'] 2023-08-23T03:49:01.955 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{rhel_8}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}'] 2023-08-23T03:49:01.956 INFO:scrape: 2023-08-23T03:49:01.956 INFO:scrape:Failure: Command failed on smithi017 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib' 2023-08-23T03:49:01.956 INFO:scrape:1 jobs: ['7375722'] 2023-08-23T03:49:01.957 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'fs/multifs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug}', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/failover}'] 2023-08-23T03:49:01.957 INFO:scrape: 2023-08-23T03:49:01.957 INFO:scrape:Failure: "2023-08-22T13:58:20.387380+0000 mon.a (mon.0) 621 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log 2023-08-23T03:49:01.958 INFO:scrape:1 jobs: ['7375798'] 2023-08-23T03:49:01.958 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/multimds_misc}'] 2023-08-23T03:49:01.958 INFO:scrape: 2023-08-23T03:49:01.969 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/ failed: 29 dead: 7 running: 0 waiting: 0 queued: 0 passed: 161 Fail ================================================================= [7375692] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 00:26:16 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375692/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375692/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f134e137fdf9450d9a6d6cb009c1a056 Test failure: test_mirroring (unittest.loader._FailedTest) [7375693] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} ----------------------------------------------------------------- time: 00:23:53 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375693/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375693/ sentry: https://sentry.ceph.com/organizations/ceph/?query=733ab8f679c74bc990b1a47a40355d45 No module named 'tasks.mds_pre_upgrade' [7375700] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} ----------------------------------------------------------------- time: 00:24:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375700/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efd50d9406214c7792eeb5008f815617 No module named 'tasks.fs' [7375702] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} ----------------------------------------------------------------- time: 00:18:58 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375702/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b801bf988d4242d6a7ba5c10e51a89b5 No module named 'tasks.cephfs_test_runner' [7375703] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} ----------------------------------------------------------------- time: 00:18:21 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375703/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2af583aa105e4624996c300f6e565001 Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) [7375707] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} ----------------------------------------------------------------- time: 00:17:55 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375707/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375707/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ecc391e39f134d938db91202db0a5551 Command failed (workunit test fs/quota/quota.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' [7375710] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} ----------------------------------------------------------------- time: 00:16:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375710/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375710/ sentry: https://sentry.ceph.com/organizations/ceph/?query=668cde55728849d6b8771e25c8883f73 No module named 'tasks.ceph_fuse' [7375711] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} ----------------------------------------------------------------- time: 00:14:50 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375711/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375711/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5e7758dcbc84669ac0deecf1735e14b No module named 'tasks.cephfs.fuse_mount' [7375713] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 02:42:02 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375713/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375713/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93e80713c9fa48bbb9adbd9b7a6be698 Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh' [7375716] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} ----------------------------------------------------------------- time: 00:12:37 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375716/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b322285aef364da19a0afa7135571a41 No module named 'tasks.cephfs.fuse_mount' [7375717] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:11:47 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375717/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375717/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c4854d78e684c268f43b82391be045c No module named 'tasks.cephadm' [7375721] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:16:06 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375721/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375721/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32e260cef1a047ab94d9a2b1206ed166 Command failed on smithi153 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7375722] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375722/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375722/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b503bc56ee14e5e9ead9b92d7d56d00 Command failed on smithi017 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs- mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid- devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf- devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio- devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql- server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql- contrib' [7375733] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375733/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375733/ sentry: https://sentry.ceph.com/organizations/ceph/?query=714afc3a6cfa4e3b94931f33b8af9964 No module named 'tasks' [7375737] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:15:26 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375737/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375737/ sentry: https://sentry.ceph.com/organizations/ceph/?query=212a8270c56244e29de536998f871f2b No module named 'tasks' [7375738] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375738/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375738/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d52f194a9eb43e49b678609700cde99 No module named 'tasks' [7375752] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:16:23 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375752/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375752/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77207e3aec9743ff85f2a5f0047c8a2a Command failed on smithi107 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7375765] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:26:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375765/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375765/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94b441eb44ea43f99a8be64da424ea9c Command failed (workunit test kernel_untar_build.sh) on smithi178 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' [7375782] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} ----------------------------------------------------------------- time: 00:29:51 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375782/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375782/ "2023-08-22T13:37:03.801838+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench result of 98570.543126 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.5. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log [7375793] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:47:07 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375793/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375793/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b65e56db8f8d4eb6ad8180994fda63d6 Command failed (workunit test suites/ffsb.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' [7375798] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} ----------------------------------------------------------------- time: 00:24:18 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375798/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375798/ "2023-08-22T13:58:20.387380+0000 mon.a (mon.0) 621 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log [7375814] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} ----------------------------------------------------------------- time: 00:15:12 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375814/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93836b2b00894898ad86d558365af638 Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) [7375818] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:16:36 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375818/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ac8400d5a914702b8b397fa35ad82eb Command failed on smithi119 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7375835] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} ----------------------------------------------------------------- time: 00:19:24 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375835/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efde58356e11430fa2e34d4dc4ec549d Command failed (workunit test fs/test_python.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' [7375838] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:27:01 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375838/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375838/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a27d0c31821d45e08d2fc045166b95e7 Command failed (workunit test kernel_untar_build.sh) on smithi133 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' [7375848] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:15:42 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375848/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375848/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45d9c5496ee245c0a627ff8e56ce5f09 Command failed on smithi194 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7375861] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} ----------------------------------------------------------------- time: 08:06:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375861/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375861/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ed860acf10641d69f42a7ba88cbe89d Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) [7375865] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} ----------------------------------------------------------------- time: 00:18:52 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375865/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99ff17176c2c42cb9aedb171a84ee083 Command failed (workunit test fs/quota/quota.sh) on smithi175 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=54fd6f849d61b151541bf28aca0de4ec83da7fd3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' [7375867] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} ----------------------------------------------------------------- time: 00:20:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375867/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42c8ed8c04184077af7193086c81eeb3 Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) Dead ================================================================= [7375687] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375687/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375687/ hit max job timeout [7375708] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/iozone}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375708/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375708/ Error reimaging machines: Timeout opening channel. [7375729] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375729/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375729/ Error reimaging machines: Timeout opening channel. [7375748] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375748/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375748/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7375753] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375753/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375753/ hit max job timeout [7375819] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375819/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375819/ hit max job timeout [7375831] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375831/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375831/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7375685] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 00:38:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375685/ [7375686] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 01:03:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375686/ [7375688] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:19:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375688/ [7375689] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} time: 00:53:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375689/ [7375690] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:04:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375690/ [7375691] fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/fstop} time: 00:17:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375691/ [7375694] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} time: 00:19:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375694/ [7375695] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:17:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375695/ [7375696] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:46:39 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375696/ [7375697] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:19:35 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375697/ [7375698] fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:17:44 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375698/ [7375699] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} time: 00:16:30 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375699/ [7375701] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:20:09 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375701/ [7375704] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-iozone}} time: 02:34:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375704/ [7375705] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:26:31 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375705/ [7375706] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:22:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375706/ [7375709] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:25:35 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375709/ [7375712] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:27:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375712/ [7375714] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:31 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375714/ [7375715] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:51 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375715/ [7375718] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} time: 00:17:37 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375718/ [7375719] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:23:47 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375719/ [7375720] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375720/ [7375723] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:51:03 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375723/ [7375724] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} time: 00:25:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375724/ [7375725] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} time: 00:24:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375725/ [7375726] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:30:59 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375726/ [7375727] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} time: 00:15:36 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375727/ [7375728] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} time: 00:42:46 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375728/ [7375730] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:28:50 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375730/ [7375731] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:43:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375731/ [7375732] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:23:57 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375732/ [7375734] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} time: 00:15:31 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375734/ [7375735] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:26:45 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375735/ [7375736] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} time: 00:19:24 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375736/ [7375739] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} time: 00:17:33 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375739/ [7375740] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:21:30 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375740/ [7375741] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} time: 00:40:43 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375741/ [7375742] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:19:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375742/ [7375743] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} time: 00:23:14 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375743/ [7375744] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} time: 00:15:55 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375744/ [7375745] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:32:23 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375745/ [7375746] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:23:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375746/ [7375747] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} time: 01:20:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375747/ [7375749] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} time: 01:33:20 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375749/ [7375750] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} time: 01:01:49 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375750/ [7375751] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:17:12 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375751/ [7375754] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:43:13 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375754/ [7375755] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} time: 01:55:39 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375755/ [7375756] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} time: 00:26:04 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375756/ [7375757] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:20:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375757/ [7375758] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:27:22 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375758/ [7375759] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} time: 00:44:43 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375759/ [7375760] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} time: 00:48:33 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375760/ [7375761] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:22:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375761/ [7375762] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:18:48 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375762/ [7375763] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:26 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375763/ [7375764] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} time: 01:02:03 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375764/ [7375766] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:51:31 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375766/ [7375767] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:17:53 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375767/ [7375768] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:18:18 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375768/ [7375769] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} time: 00:44:59 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375769/ [7375770] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:23 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375770/ [7375771] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} time: 00:23:02 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375771/ [7375772] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 03:10:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375772/ [7375773] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:26:08 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375773/ [7375774] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} time: 00:26:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375774/ [7375775] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 00:45:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375775/ [7375776] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} time: 00:57:17 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375776/ [7375777] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-dbench}} time: 01:14:01 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375777/ [7375778] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} time: 01:09:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375778/ [7375779] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} time: 01:00:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375779/ [7375780] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} time: 00:14:33 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375780/ [7375781] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:40:26 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375781/ [7375783] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:19:46 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375783/ [7375784] fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health} time: 00:25:29 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375784/ [7375785] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} time: 00:38:07 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375785/ [7375786] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 01:01:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375786/ [7375787] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 01:25:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375787/ [7375788] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:13 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375788/ [7375789] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 02:16:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375789/ [7375790] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/lockdep} time: 00:54:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375790/ [7375791] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:27:11 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375791/ [7375792] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} time: 00:14:56 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375792/ [7375794] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:30:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375794/ [7375795] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:18:58 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375795/ [7375796] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} time: 00:34:57 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375796/ [7375797] fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:16:56 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375797/ [7375799] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:20:21 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375799/ [7375800] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}} time: 00:16:20 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375800/ [7375801] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} time: 00:27:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375801/ [7375802] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:44:30 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375802/ [7375803] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:38:56 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375803/ [7375804] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} time: 00:16:47 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375804/ [7375805] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 01:26:53 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375805/ [7375806] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} time: 00:24:23 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375806/ [7375807] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} time: 00:17:11 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375807/ [7375808] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} time: 00:14:49 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375808/ [7375809] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:45 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375809/ [7375810] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:17:40 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375810/ [7375811] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:23:43 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375811/ [7375812] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:20:24 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375812/ [7375813] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} time: 00:43:59 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375813/ [7375815] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:26:35 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375815/ [7375816] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:26:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375816/ [7375817] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} time: 00:16:20 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375817/ [7375820] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:38:24 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375820/ [7375821] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:20:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375821/ [7375822] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} time: 00:32:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375822/ [7375823] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} time: 00:29:34 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375823/ [7375824] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:25:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375824/ [7375825] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} time: 00:18:20 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375825/ [7375826] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:18:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375826/ [7375827] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} time: 00:45:03 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375827/ [7375828] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 01:54:05 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375828/ [7375829] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 03:41:55 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375829/ [7375830] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:22:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375830/ [7375832] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} time: 00:27:38 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375832/ [7375833] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} time: 00:14:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375833/ [7375834] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:19:51 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375834/ [7375836] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:20:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375836/ [7375837] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:39:32 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375837/ [7375839] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:20:51 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375839/ [7375840] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:32:21 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375840/ [7375841] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} time: 00:28:38 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375841/ [7375842] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:17:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375842/ [7375843] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/test_o_trunc}} time: 00:36:07 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375843/ [7375844] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} time: 00:39:31 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375844/ [7375845] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:29:16 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375845/ [7375846] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:58 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375846/ [7375847] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} time: 00:21:13 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375847/ [7375849] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 01:23:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375849/ [7375850] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:56:28 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375850/ [7375851] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/iogen}} time: 00:48:08 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375851/ [7375852] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:48:50 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375852/ [7375853] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} time: 00:15:10 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375853/ [7375854] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:26:46 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375854/ [7375855] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} time: 00:20:52 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375855/ [7375856] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-pjd}} time: 00:21:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375856/ [7375857] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} time: 00:45:19 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375857/ [7375858] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:21:16 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375858/ [7375859] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:19:55 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375859/ [7375860] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:20:21 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375860/ [7375862] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/iozone}} time: 00:25:56 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375862/ [7375863] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:18:27 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375863/ [7375864] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} time: 01:51:02 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375864/ [7375866] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:16:47 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375866/ [7375868] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:26:03 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375868/ [7375869] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/pjd}} time: 00:39:48 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375869/ [7375870] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:21:49 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375870/ [7375871] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:29:33 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375871/ [7375872] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:28:18 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375872/ [7375873] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} time: 01:36:18 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375873/ [7375874] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:36:54 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375874/ [7375875] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} time: 00:15:00 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375875/ [7375876] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:46 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375876/ [7375877] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:21:05 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375877/ [7375878] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} time: 00:18:12 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375878/ [7375879] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host} time: 00:50:41 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375879/ [7375880] fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} time: 00:23:25 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375880/ [7375881] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} time: 00:15:23 info: http://pulpito.ceph.com/vshankar-2023-08-22_10:18:46-fs-wip-vshankar-testing-20230822.064807-testing-default-smithi/7375881/