2022-09-08T06:02:51.966 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-08T06:02:51.968 INFO:teuthology.results:subset: '111/120000'
2022-09-08T06:02:51.968 INFO:teuthology.results:seed: '620'
2022-09-09T05:10:42.333 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-09T05:10:42.365 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-09-09T07:26:54.607 INFO:teuthology.results:Tests finished! gathering results...
2022-09-09T07:27:13.618 INFO:scrape:Found 184 jobs
2022-09-09T07:27:16.014 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi155/log/ceph-mgr.x.log.gz
2022-09-09T07:27:16.017 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi106/log/ceph-mgr.y.log.gz
2022-09-09T07:27:16.017 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:16.038 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi155/log/ceph-mgr.x.log.gz
2022-09-09T07:27:16.040 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi106/log/ceph-mgr.y.log.gz
2022-09-09T07:27:16.041 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:16.077 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi155/log/ceph-mgr.x.log.gz
2022-09-09T07:27:16.078 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi106/log/ceph-mgr.y.log.gz
2022-09-09T07:27:16.079 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:16.098 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi155/log/ceph-mgr.x.log.gz
2022-09-09T07:27:16.099 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/remote/smithi106/log/ceph-mgr.y.log.gz
2022-09-09T07:27:16.099 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:16.107 WARNING:scrape:Misunderstood line: 
2022-09-09T07:27:18.529 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015589/remote/smithi037/log/ceph-mgr.y.log.gz
2022-09-09T07:27:18.533 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015589/remote/smithi096/log/ceph-mgr.x.log.gz
2022-09-09T07:27:18.534 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:20.454 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015678/remote/smithi196/log/ceph-mgr.x.log.gz
2022-09-09T07:27:20.457 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015678/remote/smithi146/log/ceph-mgr.y.log.gz
2022-09-09T07:27:20.457 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:21.101 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015673/remote/smithi008/log/ceph-mgr.y.log.gz
2022-09-09T07:27:21.103 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015673/remote/smithi084/log/ceph-mgr.x.log.gz
2022-09-09T07:27:21.104 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:23.130 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015647/remote/smithi039/log/ceph-mgr.y.log.gz
2022-09-09T07:27:23.133 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015647/remote/smithi134/log/ceph-mgr.x.log.gz
2022-09-09T07:27:23.134 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:23.335 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015645/remote/smithi070/log/ceph-mgr.y.log.gz
2022-09-09T07:27:23.337 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015645/remote/smithi080/log/ceph-mgr.x.log.gz
2022-09-09T07:27:23.337 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:24.866 WARNING:scrape:Misunderstood line: 
2022-09-09T07:27:24.917 WARNING:scrape:Misunderstood line: 
2022-09-09T07:27:26.376 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015577/remote/smithi171/log/ceph-mgr.x.log.gz
2022-09-09T07:27:26.378 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015577/remote/smithi063/log/ceph-mgr.y.log.gz
2022-09-09T07:27:26.379 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:29.190 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015560/remote/smithi105/log/ceph-mgr.y.log.gz
2022-09-09T07:27:29.193 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015560/remote/smithi189/log/ceph-mgr.x.log.gz
2022-09-09T07:27:29.194 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:35.093 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015617/remote/smithi109/log/ceph-mgr.y.log.gz
2022-09-09T07:27:35.102 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015617/remote/smithi120/log/ceph-mgr.x.log.gz
2022-09-09T07:27:35.102 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:37.121 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015611/remote/smithi061/log/ceph-mgr.x.log.gz
2022-09-09T07:27:37.126 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015611/remote/smithi046/log/ceph-mgr.y.log.gz
2022-09-09T07:27:37.127 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:37.925 WARNING:scrape:Misunderstood line: 
2022-09-09T07:27:37.936 WARNING:scrape:Misunderstood line: 
2022-09-09T07:27:41.793 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015661/remote/smithi179/log/ceph-mgr.x.log.gz
2022-09-09T07:27:41.796 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015661/remote/smithi114/log/ceph-mgr.y.log.gz
2022-09-09T07:27:41.797 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:43.042 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015575/teuthology.log
2022-09-09T07:27:44.043 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015581/remote/smithi003/log/ceph-mgr.y.log.gz
2022-09-09T07:27:44.046 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015581/remote/smithi156/log/ceph-mgr.x.log.gz
2022-09-09T07:27:44.046 WARNING:scrape:Not-understood crash indication 
2022-09-09T07:27:45.204 INFO:scrape:Found 5 distinct failure reasons
2022-09-09T07:27:45.205 INFO:scrape:Failure: Command failed on smithi167 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'
2022-09-09T07:27:45.206 INFO:scrape:166 jobs
2022-09-09T07:27:45.208 INFO:scrape:suites intersection: []
2022-09-09T07:27:45.209 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-client', '1-mount', '1-rename', '2-logrotate}', '2-upgrade', '2-workload/dbench', '2-workunit/cfuse_workunit_snaptests}}', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/ffsb}}', '2-workunit/fs/snaps}}', '2-workunit/fs/trivial_sync}}', '2-workunit/iozone}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/fsstress}}', '2-workunit/suites/iozone}}', '2-workunit/suites/pjd}}', '3-client-upgrade', '3-compat_client/no}}', '3-compat_client/quincy}}', '4-compat_client', '5-client-sanity}}', 'begin/{0-install', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'cephfs-mirror/three-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'clusters/1-mds-1-client-coloc', 'clusters/1-mds-2-client', 'clusters/1-mds-2-client-micro', 'clusters/1-mds-3-client', 'clusters/1-node-1-mds-1-osd', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/small-cluster', 'conf/{client', 'debug', 'distro/single-container-host', 'distro/single-container-host}', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'distros/ubuntu_latest', 'fs/32bits/{begin/{0-install', 'fs/bugs/client_trim_caps/{begin/{0-install', 'fs/cephadm/multivolume/{0-start', 'fs/cephadm/renamevolume/{0-start', 'fs/full/{begin/{0-install', 'fs/functional/{begin/{0-install', 'fs/libcephfs/{begin/{0-install', 'fs/mirror-ha/{begin/{0-install', 'fs/mirror/{begin/{0-install', 'fs/mixed-clients/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'fs/multifs/{begin/{0-install', 'fs/permission/{begin/{0-install', 'fs/shell/{begin/{0-install', 'fs/snaps/{begin/{0-install', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/top/{begin/{0-install', 'fs/traceless/{begin/{0-install', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'fs/valgrind/{begin/{0-install', 'fs/verify/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'kclient-overrides/{distro/stock/{k-stock', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mon-debug', 'mon-debug}', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v1}', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{k-testing', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'multimds/no', 'multimds/yes', 'n/3', 'n/5', 'no_client_pidfile}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd-asserts}', 'osd}', 'overrides', 'overrides/ignorelist_health', 'overrides/ignorelist_health}', 'overrides/whitelist_health', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{faked-ino', 'overrides/{frag', 'overrides/{ignorelist_health', 'overrides/{whitelist_health}', 'pg-warn}', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'ranks/multi/{export-check', 'replication/always}', 'replication/default}', 'rhel_8}', 'scrub/no', 'scrub/yes', 'session_timeout', 'session_timeout}', 'standby-replay', 'subvolume/{no-subvolume}', 'subvolume/{with-namespace-isolated-and-quota}', 'subvolume/{with-namespace-isolated}', 'subvolume/{with-no-extra-options}', 'subvolume/{with-quota}', 'supported-random-distro$/{centos_8}', 'supported-random-distros$/{rhel_8}', 'tasks/acls}', 'tasks/admin}', 'tasks/alternate-pool}', 'tasks/asok_dump_tree}', 'tasks/auto-repair}', 'tasks/backtrace}', 'tasks/cap-flush}', 'tasks/cephfs-shell}', 'tasks/cephfs_misc_tests}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_blogbench', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/client-limits}', 'tasks/client-readahead}', 'tasks/client-recovery}', 'tasks/client}', 'tasks/damage}', 'tasks/data-scan}', 'tasks/exports}', 'tasks/failover}', 'tasks/forward-scrub}', 'tasks/fragment}', 'tasks/fsstress', 'tasks/fstop}', 'tasks/ino_release_cb}', 'tasks/ior-shared-file}', 'tasks/journal-repair}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/libcephfs/{frag', 'tasks/libcephfs_python}', 'tasks/mds-flush}', 'tasks/mds-full}', 'tasks/mds_creation_retry}', 'tasks/mdtest}', 'tasks/metrics}', 'tasks/mgr-osd-full}', 'tasks/mirror}', 'tasks/mirror}}', 'tasks/multifs-auth}', 'tasks/multimds_misc}', 'tasks/openfiletable}', 'tasks/pool-perm}', 'tasks/quota}', 'tasks/recovery-fs}', 'tasks/scrub}', 'tasks/sessionmap}', 'tasks/snap-schedule}', 'tasks/snap_schedule_snapdir}', 'tasks/snapshots}', 'tasks/strays}', 'tasks/test_journal_migration}', 'tasks/trim-i24137}', 'tasks/truncate_delay}', 'tasks/volumes/{overrides', 'tasks/workunit/dir-max-entries}', 'tasks/workunit/quota}', 'tasks/workunit/snaps}', 'tasks/{0-check-counter', 'tasks/{0-octopus', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'test/basic}}', 'test/clone}}', 'test/misc}}', 'test/snapshot}}', 'test}}', 'thrashosds-health}', 'traceless/50pc}', 'validater/lockdep}', 'workloads/cephfs-mirror-ha-workunit}', 'workunit/direct_io}}', 'workunit/fs/misc}}', 'workunit/fs/norstats}}', 'workunit/fs/test_o_trunc}}', 'workunit/kernel_untar_build}}', 'workunit/suites/blogbench}}', 'workunit/suites/dbench}}', 'workunit/suites/ffsb}}', 'workunit/suites/fsstress}}', 'workunit/suites/fsx}}', 'workunit/suites/fsync-tester}}', 'workunit/suites/iogen}}', 'workunit/suites/iozone}}', 'workunit/suites/pjd}}', 'wsync/no}', 'wsync/yes}']
2022-09-09T07:27:45.209 INFO:scrape:
2022-09-09T07:27:45.210 INFO:scrape:Failure: Test failure: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps)
2022-09-09T07:27:45.210 INFO:scrape:2 jobs: ['7015655', '7015840']
2022-09-09T07:27:45.211 INFO:scrape:suites intersection: ['1-client-upgrade', '2-client-sanity}}', 'centos_latest', 'clusters/{1-mds-1-client-micro}', 'conf/{client', 'fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-nautilus']
2022-09-09T07:27:45.211 INFO:scrape:suites union: ['1-client-upgrade', '2-client-sanity}}', 'centos_latest', 'clusters/{1-mds-1-client-micro}', 'conf/{client', 'fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-nautilus']
2022-09-09T07:27:45.212 INFO:scrape:
2022-09-09T07:27:45.212 INFO:scrape:Valgrind: mon (Leak_DefinitelyLost, Leak_PossiblyLost, Leak_StillReachable)
2022-09-09T07:27:45.213 INFO:scrape:1 jobs: ['7015635']
2022-09-09T07:27:45.213 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/1', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}']
2022-09-09T07:27:45.214 INFO:scrape:
2022-09-09T07:27:45.214 INFO:scrape:Valgrind: mon (Leak_StillReachable)
2022-09-09T07:27:45.215 INFO:scrape:2 jobs: ['7015773', '7015844']
2022-09-09T07:27:45.215 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'osd}', 'overrides/{ignorelist_health', 'session_timeout}', 'validater/valgrind}']
2022-09-09T07:27:45.215 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'ranks/1', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'tasks/fsstress', 'validater/valgrind}']
2022-09-09T07:27:45.216 INFO:scrape:
2022-09-09T07:27:45.216 INFO:scrape:Dead: None
2022-09-09T07:27:45.217 INFO:scrape:1 jobs: ['7015575']
2022-09-09T07:27:45.217 INFO:scrape:
2022-09-09T07:27:45.226 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/
failed:  171
dead:    1
running: 0
waiting: 0
queued:  0
passed:  12


Fail
=================================================================
[7015478]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:50:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015478/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015478/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1ac1ee3f3f849a9afc910e3d869a6d2

    Command failed on smithi049 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015480]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   01:46:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015480/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015480/
sentry: https://sentry.ceph.com/organizations/ceph/?query=00e69c42ac54458ebb5102b6070d4405

    Command failed on smithi003 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015482]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:15:55
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015482/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015482/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e20f09d33b9043c78c1ff23720436d39

    Command failed on smithi096 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015484]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:12:18
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015484/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015484/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c7c4a35eca7455887db6989500baa3e

    Command failed on smithi037 with status 5: 'sudo systemctl stop
    ceph-63e50a50-2f3e-11ed-8431-001a4aab830c@mon.a'

[7015486]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
-----------------------------------------------------------------
time:   01:50:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015486/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015486/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7fe3429cd96a49dd90aac19a4d6bd9de

    Command failed on smithi181 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015488]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
-----------------------------------------------------------------
time:   01:46:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015488/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015488/
sentry: https://sentry.ceph.com/organizations/ceph/?query=065f4dd5987d4c78a0b641d117c5f657

    Command failed on smithi045 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015490]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
-----------------------------------------------------------------
time:   01:50:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015490/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015490/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2050a672b7184583bc91e7a5c852c344

    Command failed on smithi139 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015492]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:50:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015492/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015492/
sentry: https://sentry.ceph.com/organizations/ceph/?query=665ccb4edb50443eb34c745ab7b3fd4f

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015494]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   01:50:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015494/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015494/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5cb1e26dae1547b4b541a29d43e59737

    Command failed on smithi171 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015496]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
-----------------------------------------------------------------
time:   01:48:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015496/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015496/
sentry: https://sentry.ceph.com/organizations/ceph/?query=989eff625ff740c892ff6866f41d0ac5

    Command failed on smithi062 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015498]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   01:50:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015498/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015498/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8359de97382644b5a786d519fdf2b93f

    Command failed on smithi167 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015502]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
-----------------------------------------------------------------
time:   01:46:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015502/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015502/
sentry: https://sentry.ceph.com/organizations/ceph/?query=255578bf7f2f448e8a2abdb1b9b9925f

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015504]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   01:50:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015504/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015504/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e38b5fb6f89f41f2a0c2b20d5e152ff6

    Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015506]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/yes standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/direct_io}}
-----------------------------------------------------------------
time:   00:17:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015506/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015506/
sentry: https://sentry.ceph.com/organizations/ceph/?query=05215bdaea5c45bc84e8542e18c5a41f

    Command failed on smithi090 with status 5: 'sudo systemctl stop ceph-
    af41f0cc-2f42-11ed-8431-001a4aab830c@mon.a'

[7015508]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
-----------------------------------------------------------------
time:   00:21:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015508/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015508/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e90e6146ad4e403abb05d2f0db7c0c11

    Command failed on smithi119 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015510]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration}
-----------------------------------------------------------------
time:   01:50:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015510/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015510/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e06c5fb0b50e4b16bc8356b3711874f4

    Command failed on smithi169 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015512]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015512/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015512/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e833f8feca134aebbdc3ba0824834038

    Command failed on smithi071 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015514]  fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python}
-----------------------------------------------------------------
time:   01:46:12
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015514/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015514/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eadf3bb67fda427ba89a6aabe0d5b9ff

    Command failed on smithi005 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015516]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015516/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015516/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3b28574f40cf41ef9fdac77b3248b60c

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015518]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   01:55:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015518/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015518/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5083179c1c74895af6ad5fd78d0ab11

    Command failed on smithi107 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015520]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay}
-----------------------------------------------------------------
time:   01:47:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015520/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015520/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d46f9edab914842b0a2af7087a6729c

    Command failed on smithi094 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015524]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   01:55:18
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015524/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015524/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9aab909482c14207988ccec6bb8c104f

    Command failed on smithi008 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015526]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries}
-----------------------------------------------------------------
time:   01:45:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015526/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015526/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e7ce5e6edd94d69945a21ebe5a249c7

    Command failed on smithi074 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015528]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/no standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/fs/misc}}
-----------------------------------------------------------------
time:   00:11:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015528/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015528/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7c35857ae5544409b8af8c72f1f36953

    Command failed on smithi110 with status 5: 'sudo systemctl stop
    ceph-5ffe830e-2f42-11ed-8431-001a4aab830c@mon.a'

[7015530]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}
-----------------------------------------------------------------
time:   01:50:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015530/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015530/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ccda34caf4f3411e97f0ac9d99a1853c

    Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015532]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   01:50:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015532/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015532/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f2613625948e46ea938ab96b8de548ac

    Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015534]  fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
-----------------------------------------------------------------
time:   01:50:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015534/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015534/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f47b52a73b864514a57e794a8aff1661

    Command failed on smithi097 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015536]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:21:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015536/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015536/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a7a02e2ad0be4f22a36e5f118ed71a29

    Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015538]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
-----------------------------------------------------------------
time:   01:50:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015538/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015538/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c66d11c932374eff8f347ef1f67ff3eb

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015540]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep}
-----------------------------------------------------------------
time:   01:47:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015540/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015540/
sentry: https://sentry.ceph.com/organizations/ceph/?query=edb72b987cf5420091793ca600a31e15

    Command failed on smithi130 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015542]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}
-----------------------------------------------------------------
time:   01:47:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015542/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015542/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8f55b51552df49c391811ce87a598614

    Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015544]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
-----------------------------------------------------------------
time:   01:46:01
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015544/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015544/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e122bc432f1948a69cee045378565cb0

    Command failed on smithi110 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015546]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
-----------------------------------------------------------------
time:   01:47:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015546/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015546/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff64b175326e4758b0c2a02a94693bae

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015548]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:55:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015548/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015548/
sentry: https://sentry.ceph.com/organizations/ceph/?query=136034f8c9de477589cdfb98861b5a7f

    Command failed on smithi090 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015550]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   01:48:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015550/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015550/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a54cf33e8d464b288c35fcc73a776449

    Command failed on smithi119 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015552]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   01:45:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015552/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015552/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8797d7a65043465db340d81e5c975c54

    Command failed on smithi040 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015556]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin}
-----------------------------------------------------------------
time:   01:45:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015556/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015556/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9b968a1bba4243aa964fc6f8e19fae74

    Command failed on smithi111 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015558]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/yes standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/kernel_untar_build}}
-----------------------------------------------------------------
time:   00:16:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015558/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015558/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d35eab1a874745928bff58b612c85759

    Command failed on smithi094 with status 5: 'sudo systemctl stop
    ceph-6bc2d402-2fcd-11ed-8431-001a4aab830c@mon.a'

[7015560]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   01:46:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015560/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015560/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f441c39cad044d7a95a4e4ddc3f641a6

    Command failed on smithi105 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015562]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:10:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015562/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015562/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c0f75363c2140dbbd5b0cdd0badab76

    Command failed on smithi081 with status 1: 'set -ex\nsudo dd
    of=/home/ubuntu/cephtest/valgrind.supp'

[7015565]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}
-----------------------------------------------------------------
time:   01:51:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015565/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015565/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a409f8c572eb40049927a6ebaa55376e

    Command failed on smithi083 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015567]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}
-----------------------------------------------------------------
time:   01:51:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015567/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015567/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a5a96c1c58b415e8b00b8dcd190b313

    Command failed on smithi133 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015569]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:16:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015569/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015569/
sentry: https://sentry.ceph.com/organizations/ceph/?query=39baec138a3d42878e90a72555d3ca4b

    Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015571]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree}
-----------------------------------------------------------------
time:   01:47:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015571/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015571/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b68dc27cd6db4521b12585a1f5b102d2

    Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015573]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:51:05
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015573/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015573/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b5c9a7d90966497a976140afd59adc26

    Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015577]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair}
-----------------------------------------------------------------
time:   01:47:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015577/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015577/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3184b15634c4e33a132dbdff80286c0

    Command failed on smithi063 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015578]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/no standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/blogbench}}
-----------------------------------------------------------------
time:   00:13:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015578/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015578/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b18e838174854b04845faf081dcfc9e5

    Command failed on smithi047 with status 5: 'sudo systemctl stop
    ceph-d3706a32-2fce-11ed-8431-001a4aab830c@mon.a'

[7015581]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}}
-----------------------------------------------------------------
time:   01:48:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015581/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015581/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9d5c46fc324c4323ba0ec6ab1866fd22

    Command failed on smithi003 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015583]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace}
-----------------------------------------------------------------
time:   01:52:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015583/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015583/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7823a9d7a02f42dd8899c1c7800f6f1c

    Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015585]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
-----------------------------------------------------------------
time:   00:23:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015585/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015585/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e116daa559b045acbb102ba83de4eb6e

    Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015587]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   01:48:18
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015587/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015587/
sentry: https://sentry.ceph.com/organizations/ceph/?query=685f6f7e776b4502bdf1a3ed315d9f94

    Command failed on smithi099 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015589]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush}
-----------------------------------------------------------------
time:   01:48:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015589/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015589/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0aa952b3e09a42ceafcb688eeee7f82b

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015591]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/dbench}}
-----------------------------------------------------------------
time:   00:17:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015591/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015591/
sentry: https://sentry.ceph.com/organizations/ceph/?query=06eb6cbf8bd9451c9dc2987f4e802165

    Command failed on smithi079 with status 5: 'sudo systemctl stop
    ceph-b1a39d56-2fcf-11ed-8431-001a4aab830c@mon.a'

[7015592]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   01:52:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015592/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015592/
sentry: https://sentry.ceph.com/organizations/ceph/?query=050214c842b346d284aab26ad958d5c1

    Command failed on smithi167 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015595]  fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137}
-----------------------------------------------------------------
time:   01:46:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015595/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015595/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0d6bcd94c7894241adee2dfca9b22233

    Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015597]  fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host}
-----------------------------------------------------------------
time:   00:07:55
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015597/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015597/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b7ef06b447cf4bf3b5a4df3354ef8abf

    Command failed on smithi112 with status 5: 'sudo systemctl stop ceph-
    fbb07fba-2fcd-11ed-8431-001a4aab830c@mon.smithi112'

[7015599]  fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full}
-----------------------------------------------------------------
time:   01:45:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015599/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015599/
sentry: https://sentry.ceph.com/organizations/ceph/?query=612a73a0dce94d40a9ceba51be71eb90

    Command failed on smithi152 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015601]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits}
-----------------------------------------------------------------
time:   01:46:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015601/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015601/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8b1f50898ff14fff99c5cf9de40f1c4b

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015602]  fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client}
-----------------------------------------------------------------
time:   01:52:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015602/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015602/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1bf3e35bf547485c9f9f9c86df584f7f

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015605]  fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{rhel_8} tasks/mirror}
-----------------------------------------------------------------
time:   01:01:22
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015605/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015605/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c1e4358da02d4f60a9a69661fd17edb7

    Command failed on smithi090 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015607]  fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:55:54
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015607/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015607/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dda310a96e6e46ab8a3d8f3b74a7d7ae

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015609]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   01:52:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015609/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015609/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a10a2e82cc448c79e610cd21b3062d7

    Command failed on smithi093 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015611]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   01:48:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015611/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015611/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2362987f5c6f4be4b151eedea5ecb858

    Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015613]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
-----------------------------------------------------------------
time:   01:52:55
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015613/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015613/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f3349c88d32241649157e01fb4c98740

    Command failed on smithi007 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015615]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   01:46:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015615/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015615/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e45f491bc43447edbf8f45cb31a9438a

    Command failed on smithi150 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015617]  fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell}
-----------------------------------------------------------------
time:   01:46:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015617/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015617/
sentry: https://sentry.ceph.com/organizations/ceph/?query=28121cb3c62e4bf1bbe68b201b0c178d

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015619]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:52:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015619/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015619/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1c7e4e58fe444c35b83c73b95737d5d0

    Command failed on smithi012 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015621]  fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/fstop}
-----------------------------------------------------------------
time:   01:00:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015621/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015621/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d377a99784294e3ab2ba34983f5b3dae

    Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015623]  fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
-----------------------------------------------------------------
time:   01:46:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015623/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb3a892e320348bcbb070c8e62e18536

    Command failed on smithi044 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015625]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:22:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015625/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015625/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0ce2869788d14b74aa0b8ce7385b5d78

    Command failed on smithi137 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015627]  fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
-----------------------------------------------------------------
time:   01:04:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015627/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015627/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3c663bd991548a1ad7aa99b22a8f146

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015629]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
-----------------------------------------------------------------
time:   01:46:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015629/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015629/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40a4ce402fea45b88cb1da8313878ebb

    Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015631]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   01:48:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015631/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015631/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b1255c1790044bb81133defb79aac19

    Command failed on smithi085 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015633]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead}
-----------------------------------------------------------------
time:   01:51:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015633/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015633/
sentry: https://sentry.ceph.com/organizations/ceph/?query=84cae7b968054892b1bf24da0ffb67d3

    Command failed on smithi050 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015635]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:56:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015635/
sentry: https://sentry.ceph.com/organizations/ceph/?query=561d3ad9e5c5464b93f6a9f13bd9667d

    saw valgrind issues

[7015637]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   01:50:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015637/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015637/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5511062f5424781868685afb9b8f085

    Command failed on smithi160 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015641]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}
-----------------------------------------------------------------
time:   01:55:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015641/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015641/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4321d9225a9843f3be9ff1957cc94417

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015643]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/no standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015643/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015643/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a97150973f73483eb3bb203deda722c5

    Command failed on smithi008 with status 5: 'sudo systemctl stop
    ceph-a2ec2d5a-2fcf-11ed-8431-001a4aab830c@mon.a'

[7015645]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   01:46:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015645/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c171aefbaaf400b93c75eaae6eb68d7

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015647]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage}
-----------------------------------------------------------------
time:   01:46:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015647/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015647/
sentry: https://sentry.ceph.com/organizations/ceph/?query=709dfd91f1644e12b44867e68ba17660

    Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015651]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}
-----------------------------------------------------------------
time:   01:50:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015651/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015651/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe2e42adc54142218255ed49e462d4f8

    Command failed on smithi178 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015653]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   01:50:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015653/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015653/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b10bab5509eb4edd81b53b66857662b4

    Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015655]  fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}}
-----------------------------------------------------------------
time:   00:10:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015655/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015655/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58135713cd9444e689342168fe769042

    Test failure: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps)

[7015657]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports}
-----------------------------------------------------------------
time:   01:47:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015657/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015657/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7368bf609db14a628e90288f5f3b4dd3

    Command failed on smithi125 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015659]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015659/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015659/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cbccb9be62d049da89e73fcda5838c9c

    Command failed on smithi157 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015661]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015661/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015661/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f3c454251fd244ccbb63eeb32f5e1a37

    Command failed on smithi114 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015663]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   01:50:21
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015663/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015663/
sentry: https://sentry.ceph.com/organizations/ceph/?query=204f8d385d0b451999280349824a72f5

    Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015665]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/fs/norstats}}
-----------------------------------------------------------------
time:   00:16:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015665/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015665/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0d0ec24ef0954fce99256cd36fc27cfd

    Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-
    cd47ff22-2fd2-11ed-8431-001a4aab830c@mon.a'

[7015667]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   01:46:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015667/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015667/
sentry: https://sentry.ceph.com/organizations/ceph/?query=035f66b7403c4eba9c0850e7a68d415c

    Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015669]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:15:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015669/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015669/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95e70a2fc22348aebc28732f9bcb151d

    Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015671]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   01:47:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015671/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015671/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd650ee354584cf8920c12b5b6e756a5

    Command failed on smithi053 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015672]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment}
-----------------------------------------------------------------
time:   01:50:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015672/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015672/
sentry: https://sentry.ceph.com/organizations/ceph/?query=69ef7c79448f434db08d3f0a8122fcd6

    Command failed on smithi142 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015673]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
-----------------------------------------------------------------
time:   01:46:05
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015673/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015673/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a25ad8df23a94b368c1abbbf4a507e45

    Command failed on smithi008 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015674]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
-----------------------------------------------------------------
time:   01:50:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015674/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015674/
sentry: https://sentry.ceph.com/organizations/ceph/?query=42895931ae91403cafb6fe3309a5aec6

    Command failed on smithi121 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015675]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:50:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015675/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015675/
sentry: https://sentry.ceph.com/organizations/ceph/?query=807d1b8dfe2e41a68e10af659ce0256a

    Command failed on smithi033 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015676]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   01:50:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015676/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015676/
sentry: https://sentry.ceph.com/organizations/ceph/?query=81d57ed55d424a62ac4ca7fc6f808712

    Command failed on smithi057 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015677]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   01:49:05
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015677/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015677/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58a09372b2f54e5b88ea2abb5daaddba

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015678]  fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
-----------------------------------------------------------------
time:   01:45:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015678/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015678/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9d0ba47885024d29a1fd1437e72c2b32

    Command failed on smithi146 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015680]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
-----------------------------------------------------------------
time:   01:47:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015680/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015680/
sentry: https://sentry.ceph.com/organizations/ceph/?query=23136621d11b47059349bd12b48d3bed

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015681]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair}
-----------------------------------------------------------------
time:   01:47:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015681/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015681/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b99fd43cf61441969560e053b9779766

    Command failed on smithi032 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015683]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/no standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:11:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015683/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015683/
sentry: https://sentry.ceph.com/organizations/ceph/?query=586283000ea6429d8586096773031d66

    Command failed on smithi043 with status 5: 'sudo systemctl stop
    ceph-b93d16aa-2fd4-11ed-8431-001a4aab830c@mon.a'

[7015685]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush}
-----------------------------------------------------------------
time:   01:45:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015685/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015685/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3229255b0a44d738120ba454078f05c

    Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015687]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   01:45:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015687/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015687/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2596d35aab1a4a21b017ee406ad87e14

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015689]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
-----------------------------------------------------------------
time:   00:21:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015689/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015689/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1dc23539024242c2a96294afd43b8b57

    Command failed on smithi150 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015691]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep}
-----------------------------------------------------------------
time:   01:55:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015691/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015691/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b33c08fd2e04c42a3e0350d2db7a33c

    Command failed on smithi081 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015693]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}
-----------------------------------------------------------------
time:   01:50:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015693/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015693/
sentry: https://sentry.ceph.com/organizations/ceph/?query=594cde211809432e8e69db4c12ed2f54

    Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015695]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   01:45:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015695/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015695/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f5c24bd2cb646d5820db68d29c027c9

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015697]  fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb}
-----------------------------------------------------------------
time:   01:45:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015697/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015697/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6cf7d050b36e40138c4c5aca67d5ea1c

    Command failed on smithi099 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015699]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   01:45:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015699/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015699/
sentry: https://sentry.ceph.com/organizations/ceph/?query=76884751ff794159bb50b844ecfc41ee

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015701]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}}
-----------------------------------------------------------------
time:   01:50:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015701/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015701/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4c103c555cd34b47bad124e641b6ce43

    Command failed on smithi012 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015703]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry}
-----------------------------------------------------------------
time:   01:47:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015703/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015703/
sentry: https://sentry.ceph.com/organizations/ceph/?query=713f1bf85b30428da9426375e5acc6db

    Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015707]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/yes standby-replay subvolume/{with-no-extra-options} tasks/{0-check-counter workunit/suites/fsx}}
-----------------------------------------------------------------
time:   00:16:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015707/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015707/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6bd09bdaeabe4b03bf6e5588c616c0cb

    Command failed on smithi093 with status 5: 'sudo systemctl stop
    ceph-4310d988-2fe0-11ed-8431-001a4aab830c@mon.a'

[7015709]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:50:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015709/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015709/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04466ac436744369a56fb56c9c330902

    Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015711]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics}
-----------------------------------------------------------------
time:   01:45:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015711/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015711/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13b6dd3cfac14950978c447418fbf03d

    Command failed on smithi167 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015713]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:22:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015713/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015713/
sentry: https://sentry.ceph.com/organizations/ceph/?query=96d5bee37d7e47cda61c9a4d43e1c5e8

    Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015715]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc}
-----------------------------------------------------------------
time:   01:50:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015715/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015715/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d07e6e825784444c94b8045899ed1856

    Command failed on smithi050 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015717]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}}
-----------------------------------------------------------------
time:   01:50:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015717/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015717/
sentry: https://sentry.ceph.com/organizations/ceph/?query=77a32ce7ed774317a17b17501ed49f2f

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015719]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/fsync-tester}}
-----------------------------------------------------------------
time:   00:11:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015719/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015719/
sentry: https://sentry.ceph.com/organizations/ceph/?query=094a5a464db24a7bae05d29479479e8f

    Command failed on smithi160 with status 5: 'sudo systemctl stop ceph-
    bd312304-2fdf-11ed-8431-001a4aab830c@mon.a'

[7015721]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable}
-----------------------------------------------------------------
time:   01:47:51
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015721/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015721/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3a982791cdd541eeb6f8e5ed22068a5e

    Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015723]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
-----------------------------------------------------------------
time:   01:46:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015723/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015723/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54ba7df44f36461e9a4e87ec54aa92cb

    Command failed on smithi085 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015725]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
-----------------------------------------------------------------
time:   01:55:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015725/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015725/
sentry: https://sentry.ceph.com/organizations/ceph/?query=682dfe9fc456426898c681b33252e6d3

    Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015727]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:55:01
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015727/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015727/
sentry: https://sentry.ceph.com/organizations/ceph/?query=06245cbad9fc4a02babd60d1007e5a63

    Command failed on smithi157 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015729]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   01:47:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015729/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015729/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8e823a6b444f4d26a5129663737a6148

    Command failed on smithi114 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015734]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   01:47:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015734/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015734/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa86c82517344a588ce825336db6fe01

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015737]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}
-----------------------------------------------------------------
time:   01:45:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015737/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015737/
sentry: https://sentry.ceph.com/organizations/ceph/?query=49c80ae1188044369f846d385e7c94c8

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015740]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015740/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015740/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cbb9d7f34f1045f3993dba15d565e151

    Command failed on smithi125 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015743]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   01:50:31
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015743/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015743/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9d1d53154ae4d9a87a092113e5d4923

    Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015746]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:45:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015746/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015746/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6cc7802376f1426698f8ceaac46322e0

    Command failed on smithi053 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015749]  fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
-----------------------------------------------------------------
time:   01:50:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015749/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015749/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d6f5a48ae8ce49bab4e29533d4132366

    Command failed on smithi136 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015752]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:16:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015752/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015752/
sentry: https://sentry.ceph.com/organizations/ceph/?query=10470022c0874ea4b489e83261e00682

    Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015755]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   01:55:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015755/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015755/
sentry: https://sentry.ceph.com/organizations/ceph/?query=27063de708074b008a97d133d3397e52

    Command failed on smithi052 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015758]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}
-----------------------------------------------------------------
time:   01:50:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015758/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015758/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f644f5a39afb48c79ece8ca9cef73210

    Command failed on smithi142 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015761]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} scrub/yes standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/fs/test_o_trunc}}
-----------------------------------------------------------------
time:   00:16:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015761/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015761/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d54916a201254f1baffbeaa1bc5b524e

    Command failed on smithi150 with status 5: 'sudo systemctl stop
    ceph-8f7cbd20-2fe3-11ed-8431-001a4aab830c@mon.a'

[7015764]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs}
-----------------------------------------------------------------
time:   01:47:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015764/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015764/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4f139bdb4ba2496581556ff7af353d0a

    Command failed on smithi174 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015767]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   01:45:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015767/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015767/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cacb6747e0d34981b1189d44cd3da991

    Command failed on smithi146 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015773]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:59:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015773/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015773/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6e664c2ad82745efbf6dd19ea2004313

    saw valgrind issues

[7015776]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}
-----------------------------------------------------------------
time:   01:46:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015776/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015776/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d51049876a104200bd956e8b3a87862b

    Command failed on smithi057 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015779]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   01:45:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015779/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015779/
sentry: https://sentry.ceph.com/organizations/ceph/?query=726ad553985744efb16e595b7975d136

    Command failed on smithi074 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015782]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
-----------------------------------------------------------------
time:   00:21:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015782/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015782/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2cbc4b36422f4b449a803db57d2e65f7

    Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015784]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}
-----------------------------------------------------------------
time:   01:50:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015784/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015784/
sentry: https://sentry.ceph.com/organizations/ceph/?query=20b200245865415bb61615e45b86bd8e

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015786]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} scrub/no standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/iogen}}
-----------------------------------------------------------------
time:   00:12:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015786/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015786/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65b9a30b54664f1ca54d03e9b28eb201

    Command failed on smithi002 with status 5: 'sudo systemctl stop
    ceph-7f519a60-2fe3-11ed-8431-001a4aab830c@mon.a'

[7015788]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   01:50:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015788/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015788/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04dbf15b6de247d9a021f99ce5485f6e

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015790]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:47:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015790/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015790/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9504b925b4d7479db4a3679db7db6efe

    Command failed on smithi032 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015794]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:50:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015794/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015794/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b3caf395305646e9bbde7786ba9f1a7b

    Command failed on smithi087 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015795]  fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health}
-----------------------------------------------------------------
time:   00:30:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015795/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015795/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5f4e99b1237b4c7d8256f102f46ec157

    Command failed on smithi073 with status 5: 'sudo systemctl stop
    ceph-a3e54b96-2fe4-11ed-8431-001a4aab830c@mon.smithi073'

[7015797]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
-----------------------------------------------------------------
time:   01:50:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015797/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015797/
sentry: https://sentry.ceph.com/organizations/ceph/?query=152f9966cc1d4ea387834227076c70ea

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015799]  fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}
-----------------------------------------------------------------
time:   01:50:31
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015799/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015799/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df7834d58bc74a22a8ed67545e236f1a

    Command failed on smithi007 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015801]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   01:46:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015801/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015801/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9da015044a65476e87be0b3a8300a3d9

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015803]  fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
-----------------------------------------------------------------
time:   01:45:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015803/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015803/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df42e541ec454d4f9254f85ac650df85

    Command failed on smithi188 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015805]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   01:50:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015805/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015805/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d5b1299f0ad546e79e93902d2650f5b6

    Command failed on smithi093 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015808]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:50:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015808/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015808/
sentry: https://sentry.ceph.com/organizations/ceph/?query=afa4af55e5b146f38436189954258142

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015810]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   01:50:21
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015810/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015810/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bd6bfe9035834531b6aff7f8e96f23b1

    Command failed on smithi063 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015812]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   01:50:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015812/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015812/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5de7912d60aa4b32a9f98b89c5b10f14

    Command failed on smithi121 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015814]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
-----------------------------------------------------------------
time:   01:50:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015814/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015814/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99bbf37c0d3e4ecc9ccd024fbe20454d

    Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015816]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:21:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015816/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015816/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f784e3606024068b76bea2d8cce91ee

    Command failed on smithi103 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7015818]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} scrub/yes standby-replay subvolume/{with-namespace-isolated} tasks/{0-check-counter workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:18:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015818/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015818/
sentry: https://sentry.ceph.com/organizations/ceph/?query=de4bf312517f41c4a7b1e81509cdcc2e

    Command failed on smithi039 with status 5: 'sudo systemctl stop
    ceph-e4798a94-2fff-11ed-8431-001a4aab830c@mon.a'

[7015820]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   01:55:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015820/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015820/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9d1033f241bc46f795fce0711f74ab71

    Command failed on smithi174 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015822]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
-----------------------------------------------------------------
time:   01:48:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015822/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015822/
sentry: https://sentry.ceph.com/organizations/ceph/?query=62d139da8615466691b7e7230e26a568

    Command failed on smithi099 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015824]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   01:49:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015824/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015824/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2184aea420f34857aaf1355ded44807f

    Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015825]  fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
-----------------------------------------------------------------
time:   01:51:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015825/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015825/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0bb09af06a69464a9fc04d4157ab9960

    Command failed on smithi066 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015830]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
-----------------------------------------------------------------
time:   01:48:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015830/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015830/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c75597652794e3ba3a21feb45ad49fe

    Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015832]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration}
-----------------------------------------------------------------
time:   01:46:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015832/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015832/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d2f1051716d242b6b1cd49bf35f8d210

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015834]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay}
-----------------------------------------------------------------
time:   01:52:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015834/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015834/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c96799c56b3e461f9906df892880daf3

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015836]  fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   01:52:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015836/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015836/
sentry: https://sentry.ceph.com/organizations/ceph/?query=875010dbcd564d49845e564baf99ccbb

    Command failed on smithi155 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015838]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} scrub/no standby-replay subvolume/{with-namespace-isolated} tasks/{0-check-counter workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:13:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015838/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015838/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa5a013d0b3f46a4ad9a1541dbdea0d2

    Command failed on smithi071 with status 5: 'sudo systemctl stop
    ceph-d8ab7902-2fff-11ed-8431-001a4aab830c@mon.a'

[7015840]  fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}}
-----------------------------------------------------------------
time:   00:11:01
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015840/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015840/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6255949a43c44d988c6ddf2e431c89ef

    Test failure: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps)

[7015842]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries}
-----------------------------------------------------------------
time:   01:48:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015842/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015842/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7789a9180a3541c5bcc4799d335f679b

    Command failed on smithi087 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015844]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:07:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015844/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015844/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1f28f87644fc47679d2f09bf4b2e6ea0

    saw valgrind issues

[7015846]  fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   01:46:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015846/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015846/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1b74fefad4eb4e1790ab9ece5431f8a9

    Command failed on smithi163 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015848]  fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   01:46:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015848/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015848/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f0e72f1a93514ad0bc6cd7a722740976

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7015850]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}
-----------------------------------------------------------------
time:   01:46:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015850/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015850/
sentry: https://sentry.ceph.com/organizations/ceph/?query=714815596efd4e3c96e0fe54a240f8f1

    Command failed on smithi142 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'



Dead
=================================================================
[7015575]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015575/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015575/

    Error reimaging machines: Failed to power on smithi012



Pass
=================================================================
[7015500] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015500/

[7015522] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015522/

[7015554] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015554/

[7015639] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015639/

[7015649] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:08:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015649/

[7015679] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015679/

[7015705] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015705/

[7015731] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:23
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015731/

[7015770] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015770/

[7015792] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015792/

[7015828] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:08:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015828/

[7015852] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:01:29-fs-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7015852/