2022-09-09T05:10:42.722 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-09T05:10:42.724 INFO:teuthology.results:subset: '111/120000'
2022-09-09T05:10:42.724 INFO:teuthology.results:seed: '6747'
2022-09-09T10:08:56.475 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-09T10:08:56.500 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-09-09T20:30:56.484 INFO:teuthology.results:Tests finished! gathering results...
2022-09-09T20:31:28.838 INFO:scrape:Found 320 jobs
2022-09-09T20:31:39.230 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:40.135 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:40.659 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:50.697 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:51.317 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:51.354 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:52.852 WARNING:scrape:Misunderstood line: 
2022-09-09T20:31:55.793 INFO:scrape:Found 9 distinct failure reasons
2022-09-09T20:31:55.794 INFO:scrape:Failure: Command failed on smithi066 with status 5: 'sudo systemctl stop ceph-72808aa4-300f-11ed-8431-001a4aab830c@mon.smithi066'
2022-09-09T20:31:55.795 INFO:scrape:282 jobs
2022-09-09T20:31:55.797 INFO:scrape:suites intersection: []
2022-09-09T20:31:55.798 INFO:scrape:suites union: ['0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-install/pacific', '1-install/quincy', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-start', '2-inject-leak/mon', '2-inject-leak/osd', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-services/basic', '2-services/rgw', '3-final}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'agent/off', 'agent/on', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_latest}', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/none', 'debug/mgr', 'fast/fast', 'fast/normal', 'fixed-2', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-basic-min-osd-mem-target', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/osds/{0-distro/ubuntu_20.04', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/smoke/{0-distro/ubuntu_20.04', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'rados/dashboard/{0-single-container-host', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/6', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/ceph_objectstore_tool', 'rados/objectstore/{backends/filejournal', 'rados/objectstore/{backends/filestore-idempotent', 'rados/objectstore/{backends/filestore-idempotent-aio-journal', 'rados/objectstore/{backends/objectcacher-stress', 'rados/perf/{ceph', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/crushdiff', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/divergent_priors', 'rados/singleton/{all/divergent_priors2', 'rados/singleton/{all/dump-stuck', 'rados/singleton/{all/ec-inconsistent-hinfo', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/lost-unfound-delete', 'rados/singleton/{all/max-pg-per-osd.from-mon', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/max-pg-per-osd.from-replica', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/osd-backfill', 'rados/singleton/{all/osd-recovery', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/peer', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/pg-removal-interruption', 'rados/singleton/{all/radostool', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/recovery-preemption', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test-noautoscale-flag', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-backfill-full', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/singleton/{all/watch-notify-same-primary', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-hybrid}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{bluestore-stupid}', 'random-objectstore$/{filestore-xfs}', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'scheduler/dmclock_1Shard_16Threads', 'scheduler/dmclock_default_shards', 'scheduler/wpq_default_shards', 'settings/optimized', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/e2e}', 'tasks/failover}', 'tasks/insights}', 'tasks/libcephsqlite}', 'tasks/module_selftest}', 'tasks/mon_clock_no_skews}', 'tasks/mon_clock_with_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/progress}', 'tasks/prometheus}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/readwrite}', 'tasks/repair_test}', 'tasks/scrub_test}', 'tasks/workunits}', 'test_iscsi_pids_limit}}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'ubuntu_latest', 'validater/lockdep}', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}', 'workloads/cache}', 'workloads/dedup-io-mixed}', 'workloads/dedup-io-snaps}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-radosbench}', 'workloads/ec-small-objects-balanced}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-fast-read}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-small-objects}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/fio_4K_rand_read}', 'workloads/fio_4K_rand_rw}', 'workloads/fio_4M_rand_read}', 'workloads/fio_4M_rand_rw}', 'workloads/fio_4M_rand_write}', 'workloads/pool-create-delete}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench_4K_rand_read}', 'workloads/radosbench_4K_seq_read}', 'workloads/radosbench_4M_rand_read}', 'workloads/radosbench_4M_seq_read}', 'workloads/radosbench_4M_write}', 'workloads/radosbench_omap_write}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/sample_fio}', 'workloads/sample_radosbench}', 'workloads/set-chunks-read}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}', 'workloads/write_fadvise_dontneed}']
2022-09-09T20:31:55.799 INFO:scrape:
2022-09-09T20:31:55.800 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC msg=audit(1662711725.134:7297): avc:  denied  { ioctl } for  pid=58937 comm="iptables" path="/var/lib/containers/storage/overlay/e9c73c1803b9b5d4bd387abad8e81a68defac6c4721ac78491b86dd1a4119fd1/merged" dev="overlay" ino=3281397 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1662711725.109:7296): avc:  denied  { ioctl } for  pid=58933 comm="iptables" path="/var/lib/containers/storage/overlay/e9c73c1803b9b5d4bd387abad8e81a68defac6c4721ac78491b86dd1a4119fd1/merged" dev="overlay" ino=3281397 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']
2022-09-09T20:31:55.800 INFO:scrape:1 jobs: ['7016706']
2022-09-09T20:31:55.801 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}']
2022-09-09T20:31:55.801 INFO:scrape:
2022-09-09T20:31:55.802 INFO:scrape:Failure: Command failed on smithi159 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml'
2022-09-09T20:31:55.802 INFO:scrape:3 jobs: ['7017114', '7016787', '7016151']
2022-09-09T20:31:55.803 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04']
2022-09-09T20:31:55.803 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2022-09-09T20:31:55.804 INFO:scrape:
2022-09-09T20:31:55.804 INFO:scrape:Failure: Command failed (workunit test mon/misc.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=df0a97fa697d229e980ce85a2573fb5244e28996 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh'
2022-09-09T20:31:55.805 INFO:scrape:1 jobs: ['7016875']
2022-09-09T20:31:55.805 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/mon}']
2022-09-09T20:31:55.806 INFO:scrape:
2022-09-09T20:31:55.806 INFO:scrape:Valgrind: mon (Leak_StillReachable)
2022-09-09T20:31:55.807 INFO:scrape:5 jobs: ['7016037', '7016548', '7016310', '7017060', '7016807']
2022-09-09T20:31:55.807 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'thrashosds-health}', 'validater/valgrind}']
2022-09-09T20:31:55.808 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}']
2022-09-09T20:31:55.808 INFO:scrape:
2022-09-09T20:31:55.809 INFO:scrape:Dead: b'2022-09-09T17:54:43.309 DEBUG:teuthology.exit:Finished running handlers'
2022-09-09T20:31:55.809 INFO:scrape:2 jobs: ['7016163', '7016795']
2022-09-09T20:31:55.810 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2022-09-09T20:31:55.810 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2022-09-09T20:31:55.811 INFO:scrape:
2022-09-09T20:31:55.811 INFO:scrape:Valgrind: mon (InvalidRead, Leak_StillReachable)
2022-09-09T20:31:55.811 INFO:scrape:1 jobs: ['7016592']
2022-09-09T20:31:55.812 INFO:scrape:suites: ['2-inject-leak/none', 'centos_latest}', 'rados/valgrind-leaks/{1-start']
2022-09-09T20:31:55.812 INFO:scrape:
2022-09-09T20:31:55.813 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
2022-09-09T20:31:55.813 INFO:scrape:1 jobs: ['7016476']
2022-09-09T20:31:55.814 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}']
2022-09-09T20:31:55.814 INFO:scrape:
2022-09-09T20:31:55.814 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=df0a97fa697d229e980ce85a2573fb5244e28996 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2022-09-09T20:31:55.815 INFO:scrape:1 jobs: ['7017221']
2022-09-09T20:31:55.815 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_cephadm}']
2022-09-09T20:31:55.816 INFO:scrape:
2022-09-09T20:31:55.827 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/
failed:  295
dead:    2
running: 0
waiting: 0
queued:  0
passed:  23


Fail
=================================================================
[7016005]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/workunits}
-----------------------------------------------------------------
time:   00:55:29
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016005/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016005/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fc0c105129814058b218b8622b76f4a6

    Command failed on smithi114 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016009]  rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
-----------------------------------------------------------------
time:   00:54:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016009/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016009/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2c46faa4a481432498404535b39f5778

    Command failed on smithi171 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016013]  rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:22
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016013/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016013/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1cd07da4097c41db86bbf5b4ce2da543

    Command failed on smithi159 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016017]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:08:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016017/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016017/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3484ae5aa3344e8dbc217b01e3fd4341

    Command failed on smithi040 with status 5: 'sudo systemctl stop
    ceph-0cdb8748-3001-11ed-8431-001a4aab830c@mon.a'

[7016021]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   00:57:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016021/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016021/
sentry: https://sentry.ceph.com/organizations/ceph/?query=945ccdc9eae24d1b971df3e464baa5b1

    Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016029]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   01:02:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016029/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016029/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99b3a7fe0a8c40dd8de004651825ebe5

    Command failed on smithi027 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016033]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:55:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016033/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016033/
sentry: https://sentry.ceph.com/organizations/ceph/?query=33d12a3147794b04aeb5c27ceef1990d

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016037]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   01:07:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016037/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016037/
sentry: https://sentry.ceph.com/organizations/ceph/?query=affd85c0b96f4a83af2608396323f3f7

    saw valgrind issues

[7016041]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   00:56:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016041/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016041/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a38f36ec302842a383b712fa98f5fb57

    Command failed on smithi078 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016045]  rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016045/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=53ea42fffb1647a08ae11412f6dc0064

    Command failed on smithi003 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016049]  rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016049/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016049/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ae985482db384989afb1b4da8168ca1d

    Command failed on smithi119 with status 5: 'sudo systemctl stop
    ceph-727ed9ba-3001-11ed-8431-001a4aab830c@mon.smithi119'

[7016053]  rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016053/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016053/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f6b29f00c44a473b80178faeb69b3702

    Command failed on smithi190 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016057]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:56:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016057/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016057/
sentry: https://sentry.ceph.com/organizations/ceph/?query=816307d35ad741aea5510caab4599381

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016061]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:55:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016061/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016061/
sentry: https://sentry.ceph.com/organizations/ceph/?query=02722b7f032444779c7245a194870b7c

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016065]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:55:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016065/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016065/
sentry: https://sentry.ceph.com/organizations/ceph/?query=15ca13e94061404caac2a8ccd5bf8b4e

    Command failed on smithi032 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016073]  rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:12
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016073/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016073/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f6240f34c89545ee85c7f22dd4b0e31d

    Command failed on smithi071 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016077]  rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:55:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016077/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016077/
sentry: https://sentry.ceph.com/organizations/ceph/?query=18308751a2bf4ef0b5226d72afbd5121

    Command failed on smithi059 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016081]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
-----------------------------------------------------------------
time:   01:01:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016081/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016081/
sentry: https://sentry.ceph.com/organizations/ceph/?query=471b3efd182b4d5ebd4062c3c96b9281

    Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016085]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect}
-----------------------------------------------------------------
time:   00:55:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016085/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016085/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4b763c90d26544b399180d0e87c26883

    Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016089]  rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:03:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016089/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016089/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dcd11066e3934e18a2c30efa8d2b7245

    Command failed on smithi012 with status 5: 'sudo systemctl stop
    ceph-b91c86b4-3002-11ed-8431-001a4aab830c@mon.a'

[7016093]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
-----------------------------------------------------------------
time:   00:54:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016093/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016093/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48c448d7c0384b3581326f019c43d8e1

    Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016097]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016097/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016097/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a3c42440b890403fa62cf31e19eaa484

    Command failed on smithi089 with status 5: 'sudo systemctl stop
    ceph-c1dae9da-3002-11ed-8431-001a4aab830c@mon.a'

[7016101]  rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016101/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016101/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7f01d23f511b45eca141422e6270b936

    Command failed on smithi189 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016105]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   01:01:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016105/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016105/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b004987454cc4f3bba3f8339ce75bc55

    Command failed on smithi176 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016109]  rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016109/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016109/
sentry: https://sentry.ceph.com/organizations/ceph/?query=32533e3468374204a6480f87e206b008

    Command failed on smithi088 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016113]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016113/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016113/
sentry: https://sentry.ceph.com/organizations/ceph/?query=23086bf20d6548d98ad462f978854f80

    Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016117]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests}
-----------------------------------------------------------------
time:   00:56:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016117/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016117/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f351c2da35f40c2baf56fa5fc3ac9b7

    Command failed on smithi040 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016121]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:04:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016121/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016121/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c7a490650554491bd53e3be42e3b365

    Command failed on smithi187 with status 5: 'sudo systemctl stop ceph-
    dd59a43a-3002-11ed-8431-001a4aab830c@mon.smithi187'

[7016125]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all}
-----------------------------------------------------------------
time:   00:55:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016125/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016125/
sentry: https://sentry.ceph.com/organizations/ceph/?query=73f2b1a7ec77456e9c3be510f024e0d7

    Command failed on smithi043 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016129]  rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:55:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016129/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016129/
sentry: https://sentry.ceph.com/organizations/ceph/?query=81b9514e6c2a486e974dcef696f2e873

    Command failed on smithi047 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016133]  rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016133/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016133/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa19073844414f3ab10cc767de432ad6

    Command failed on smithi119 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016136]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} tasks/dashboard}
-----------------------------------------------------------------
time:   00:56:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016136/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016136/
sentry: https://sentry.ceph.com/organizations/ceph/?query=671cd2a4e77347ff8d8057e99958a456

    Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016141]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash}
-----------------------------------------------------------------
time:   00:55:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016141/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016141/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b188fe61ca0f4bb584ed303a44a56ba4

    Command failed on smithi116 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016144]  rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016144/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016144/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ffb4be998774be6abc8580eb0e16e69

    Command failed on smithi050 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016149]  rados/rest/{mgr-restful supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016149/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=beab2ef8dafd4d60a7c5de88fb942fcc

    Command failed on smithi044 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016151]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:04:01
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016151/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016151/
sentry: https://sentry.ceph.com/organizations/ceph/?query=da146ee25d7340a7a60445e2bb8abe9a

    Command failed on smithi017 with status 1: 'kubectl apply -f
    https://docs.projectcalico.org/manifests/tigera-operator.yaml'

[7016155]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016155/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016155/
sentry: https://sentry.ceph.com/organizations/ceph/?query=624634ec086440888f00da7c3813eb26

    Command failed on smithi192 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016167]  rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
-----------------------------------------------------------------
time:   01:05:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016167/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4cc4b79572434646b7979f75c8fd2e08

    Command failed on smithi102 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016175]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object}
-----------------------------------------------------------------
time:   01:02:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016175/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016175/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ee6ed65ced1c423e954a30710f84739b

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016179]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   01:01:51
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016179/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016179/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dce8427177fd4e9f94d0473ae240fd7a

    Command failed on smithi033 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016183]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep}
-----------------------------------------------------------------
time:   00:56:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016183/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016183/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7e82543411d540e3894457312dad5e8a

    Command failed on smithi139 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016187]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:55:31
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016187/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016187/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6270fcf35d844f66831bc12148c18439

    Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016191]  rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016191/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016191/
sentry: https://sentry.ceph.com/organizations/ceph/?query=de4d60c652ee488095c0d06497a20459

    Command failed on smithi017 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016195]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:04:04
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016195/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016195/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d8c0131ada6745db8d217bac89518e46

    Command failed on smithi109 with status 5: 'sudo systemctl stop
    ceph-b1dec710-3005-11ed-8431-001a4aab830c@mon.a'

[7016199]  rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016199/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016199/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d655bbf05dfc49919719d72d7a7903ea

    Command failed on smithi002 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016203]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:55:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016203/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016203/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63ef18cadf7b4ce2ba442f3948c387b3

    Command failed on smithi150 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016207]  rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
-----------------------------------------------------------------
time:   00:54:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016207/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016207/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f338d5a3e344fe1a3aae663a1fa66b7

    Command failed on smithi081 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016211]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read}
-----------------------------------------------------------------
time:   00:56:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016211/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016211/
sentry: https://sentry.ceph.com/organizations/ceph/?query=178bb08c781b4bec94e4f60fe34c87d3

    Command failed on smithi133 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016215]  rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016215/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016215/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1a0927a304764913bf9e0dc9510c8dd8

    Command failed on smithi132 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016221]  rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:04:05
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016221/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016221/
sentry: https://sentry.ceph.com/organizations/ceph/?query=675aba409cf14bd1ac9b88855c2c2baf

    Command failed on smithi136 with status 5: 'sudo systemctl stop
    ceph-3d34738e-2ed3-11ed-8431-001a4aab830c@mon.smithi136'

[7016225]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
-----------------------------------------------------------------
time:   01:01:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016225/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016225/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f7727065e13347f3ae20db3ae5e58bb1

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016230]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
-----------------------------------------------------------------
time:   00:56:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016230/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=005c12b3e2c642efa93391fcbe648c89

    Command failed on smithi114 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016234]  rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016234/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016234/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c67d580cf03f473c808c2f97fc361d73

    Command failed on smithi089 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016237]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced}
-----------------------------------------------------------------
time:   00:55:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016237/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016237/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48922c3511bc4ddeb4b0f5a7c7b867c4

    Command failed on smithi159 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7016242]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python}
-----------------------------------------------------------------
time:   00:55:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016242/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016242/
sentry: https://sentry.ceph.com/organizations/ceph/?query=19e8efd5b4004fa1937b52c5293aeaa9

    Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016246]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:03:58
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016246/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016246/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5fecbd60ca70497a9eb7307432fd3860

    Command failed on smithi112 with status 5: 'sudo systemctl stop
    ceph-91947910-3009-11ed-8431-001a4aab830c@mon.smithi112'

[7016250]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:56:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016250/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016250/
sentry: https://sentry.ceph.com/organizations/ceph/?query=213a564b0ba84544ab9c563ac659112d

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016254]  rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016254/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016254/
sentry: https://sentry.ceph.com/organizations/ceph/?query=31d4ecb9d4d24453a66152cf938060d5

    Command failed on smithi134 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016257]  rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016257/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016257/
sentry: https://sentry.ceph.com/organizations/ceph/?query=995a5270eff94acb91a64c5675f51d2d

    Command failed on smithi070 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016260]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized}
-----------------------------------------------------------------
time:   00:56:18
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016260/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016260/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5906bb714a274b878854ce4c6f14aac4

    Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7016264]  rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:29
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016264/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016264/
sentry: https://sentry.ceph.com/organizations/ceph/?query=363f986464804b6e8097219acd5f3738

    Command failed on smithi032 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016273]  rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:54:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016273/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016273/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6c415a3fdac54b03b4c0be2d89345128

    Command failed on smithi111 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016278]  rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016278/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016278/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6500f49397c14330a74961d88f8e3cfc

    Command failed on smithi105 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016282]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
-----------------------------------------------------------------
time:   00:54:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016282/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016282/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f38b44ab1a9442eeb52034004f104042

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016286]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/failover}
-----------------------------------------------------------------
time:   01:01:49
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016286/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016286/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab1b3baab28345f595b461b78a2672b6

    Command failed on smithi027 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016290]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   00:56:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016290/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016290/
sentry: https://sentry.ceph.com/organizations/ceph/?query=487273c1be864848bc3f0dbdb763edd2

    Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016302]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects}
-----------------------------------------------------------------
time:   00:56:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016302/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016302/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fcff8c9a907e457ca9d7163c45f2553d

    Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7016306]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:06:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016306/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016306/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c3538cbaf9742fbac29ad20a11b1fd7

    Command failed on smithi018 with status 5: 'sudo systemctl stop
    ceph-74e35578-300b-11ed-8431-001a4aab830c@mon.a'

[7016310]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:07:22
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016310/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016310/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4fe664d63b57499b8215c48d2c96d009

    saw valgrind issues

[7016314]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:04:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016314/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016314/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a459e444c52d4fd795f38bda98737cb3

    Command failed on smithi040 with status 5: 'sudo systemctl stop
    ceph-752bc66e-300b-11ed-8431-001a4aab830c@mon.a'

[7016318]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:03:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016318/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016318/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4ed2f97eee5b4386884d8837c60172c5

    Command failed on smithi080 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016322]  rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016322/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016322/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e56aa7478af47158c0fbc956c7612b7

    Command failed on smithi116 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016326]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:56:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016326/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016326/
sentry: https://sentry.ceph.com/organizations/ceph/?query=66d2e6853a114d84967c4a63eabd6208

    Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016330]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:07:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016330/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016330/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ded453d706b343b8b5db9924b0174b46

    Command failed on smithi043 with status 5: 'sudo systemctl stop
    ceph-477d0402-300c-11ed-8431-001a4aab830c@mon.a'

[7016334]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced}
-----------------------------------------------------------------
time:   00:56:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016334/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016334/
sentry: https://sentry.ceph.com/organizations/ceph/?query=16535187976c43b19a69576c96cd5ede

    Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016338]  rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:54
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016338/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016338/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58b76c3c99bf4e96a8dcb1b7339a779b

    Command failed on smithi189 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016342]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch}
-----------------------------------------------------------------
time:   01:00:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016342/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016342/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ca37bc9e176b44f39a1424d3acdb5c70

    Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016346]  rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:55:06
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016346/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016346/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a828e25c37fd4f44a137485c105cf614

    Command failed on smithi073 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016350]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
-----------------------------------------------------------------
time:   00:57:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016350/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016350/
sentry: https://sentry.ceph.com/organizations/ceph/?query=efbf533311964af9bd6feff7725ec7d6

    Command failed on smithi003 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016354]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:09:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016354/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016354/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d400e4df24f944788c0b97a2ec8aeabe

    Command failed on smithi071 with status 5: 'sudo systemctl stop
    ceph-f88cf702-300c-11ed-8431-001a4aab830c@mon.smithi071'

[7016358]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized}
-----------------------------------------------------------------
time:   00:55:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016358/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016358/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fb6998523e0e4b1ea31d62785922fa49

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016362]  rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016362/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016362/
sentry: https://sentry.ceph.com/organizations/ceph/?query=974df6f2836845b18279e89c35eaed30

    Command failed on smithi018 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016366]  rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
-----------------------------------------------------------------
time:   00:54:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016366/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016366/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7093b550ed0446a9aa9301f86088bd77

    Command failed on smithi192 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016370]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:56:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016370/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016370/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5f794109f6f4d509ceecfaa4874cb29

    Command failed on smithi040 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016374]  rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016374/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016374/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ca3a1bb1f3e4d2bbeea39a4488e05fb

    Command failed on smithi044 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016378]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:09:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016378/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016378/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d73af7dd0d1a4ffaa940daeb7f55705a

    Command failed on smithi139 with status 5: 'sudo systemctl stop
    ceph-e2304904-300d-11ed-8431-001a4aab830c@mon.a'

[7016382]  rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016382/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016382/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68ee40eb78b74fe0ae91ed338ccb1231

    Command failed on smithi203 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016386]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   01:01:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016386/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016386/
sentry: https://sentry.ceph.com/organizations/ceph/?query=50da9dd84bfd4a87a29d770eeb9de922

    Command failed on smithi057 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016391]  rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   01:01:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016391/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016391/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a750145896e43a1809f339019eff336

    Command failed on smithi039 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016395]  rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016395/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016395/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0049ceec9cc433895dcc5ae12eb4d61

    Command failed on smithi190 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016399]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
-----------------------------------------------------------------
time:   00:55:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016399/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016399/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68ae7b0c351d4d9f86860a05260714b2

    Command failed on smithi160 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016403]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:06:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016403/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016403/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b9b891fb8fbe4753a245e89ea80cd159

    Command failed on smithi093 with status 5: 'sudo systemctl stop
    ceph-718d3418-300e-11ed-8431-001a4aab830c@mon.a'

[7016406]  rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016406/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016406/
sentry: https://sentry.ceph.com/organizations/ceph/?query=97519a4450e340f5965220e368703fc2

    Command failed on smithi049 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016410]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:56:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016410/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016410/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4daf71443724f1daff687c43faf15e5

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016414]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   01:02:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016414/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016414/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3ec2c1b37424b2a946af11db2eeffc6

    Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016419]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed}
-----------------------------------------------------------------
time:   00:55:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016419/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016419/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7538797002b44fa0b9f170632042f7b4

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016423]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/insights}
-----------------------------------------------------------------
time:   00:54:55
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016423/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016423/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d58578d81aac463abe1e397266004ea6

    Command failed on smithi099 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016427]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:56:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016427/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016427/
sentry: https://sentry.ceph.com/organizations/ceph/?query=625e0d75a8c94f9bb56b8377806d2b81

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016431]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper}
-----------------------------------------------------------------
time:   01:00:23
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016431/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016431/
sentry: https://sentry.ceph.com/organizations/ceph/?query=116a0351bd8f42519485026a2780d29c

    Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016435]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016435/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016435/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8d4b304e659a49439127af0a41444690

    Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016439]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016439/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016439/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c5bf253a1efa4b38b97962fae6b8151c

    Command failed on smithi066 with status 5: 'sudo systemctl stop
    ceph-72808aa4-300f-11ed-8431-001a4aab830c@mon.smithi066'

[7016443]  rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016443/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016443/
sentry: https://sentry.ceph.com/organizations/ceph/?query=607c31b79311438b8ada3e3a36a88ad0

    Command failed on smithi152 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016452]  rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:29
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016452/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016452/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fefdfb27882e4540aa395a0710e42eaa

    Command failed on smithi163 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016456]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:55:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016456/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016456/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65d1409660684711bf72b2734bc41bb9

    Command failed on smithi074 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016460]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests}
-----------------------------------------------------------------
time:   01:01:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016460/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016460/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1def7d08f6d84ce8930e25073b665263

    Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016464]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
-----------------------------------------------------------------
time:   00:54:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016464/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016464/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8da97843cbbe430788811ecba1e69417

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016468]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:09:22
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016468/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016468/
sentry: https://sentry.ceph.com/organizations/ceph/?query=34fae2332de6476a909af423704c5134

    Command failed on smithi174 with status 5: 'sudo systemctl stop
    ceph-95252d6c-300f-11ed-8431-001a4aab830c@mon.a'

[7016472]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e}
-----------------------------------------------------------------
time:   00:07:04
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016472/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016472/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c06d9a31b55e468d9e3f49272072d6e7

    Command failed on smithi026 with status 5: 'sudo systemctl stop
    ceph-952efb4e-300f-11ed-8431-001a4aab830c@mon.a'

[7016476]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:25:04
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016476/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016476/
sentry: https://sentry.ceph.com/organizations/ceph/?query=92a8f3e8d226402298333719992a9a50

    'check osd count' reached maximum tries (90) after waiting for 900 seconds

[7016480]  rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:51
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016480/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016480/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4d2c977ec3654ed98131b2922b3903c6

    Command failed on smithi161 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016484]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   00:54:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016484/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016484/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8f992836876e4d25aa1f46ecb946c3ac

    Command failed on smithi087 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016488]  rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:55:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016488/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016488/
sentry: https://sentry.ceph.com/organizations/ceph/?query=38889a79b39e47ddbfbef94d61bbce0b

    Command failed on smithi093 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016493]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:06:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016493/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016493/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3bfbb2f4d0aa4be498fbde2390f47a79

    Command failed on smithi132 with status 5: 'sudo systemctl stop
    ceph-74fccb48-3010-11ed-8431-001a4aab830c@mon.a'

[7016497]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:12:18
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016497/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016497/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2005155ca3e048d385fee60713a883a7

    Command failed on smithi133 with status 5: 'sudo systemctl stop
    ceph-3064a522-3011-11ed-8431-001a4aab830c@mon.a'

[7016501]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big}
-----------------------------------------------------------------
time:   00:56:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016501/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016501/
sentry: https://sentry.ceph.com/organizations/ceph/?query=843c227a54c14da2a0f308d7598132c7

    Command failed on smithi114 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016504]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:55:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016504/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016504/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e0902563cd324863bdb212337996a5d6

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016508]  rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016508/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016508/
sentry: https://sentry.ceph.com/organizations/ceph/?query=748228263701486a9919dec6bc39db9a

    Command failed on smithi089 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016512]  rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016512/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016512/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ceb40f8491040c4b066855d4c8418a5

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016516]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016516/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016516/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8872a724566e4019857b64f853763059

    Command failed on smithi171 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016520]  rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:09:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016520/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016520/
sentry: https://sentry.ceph.com/organizations/ceph/?query=130b754a815e400c8ffc66fe9be54d18

    Command failed on smithi050 with status 5: 'sudo systemctl stop
    ceph-366d4912-2f7e-11ed-8431-001a4aab830c@mon.smithi050'

[7016524]  rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:56:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016524/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016524/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa0e054c60364e57a52b15d10945475c

    Command failed on smithi159 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016528]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small}
-----------------------------------------------------------------
time:   00:55:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016528/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016528/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ed904407c0e414aa63aa2a2b07c998f

    Command failed on smithi066 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016532]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big}
-----------------------------------------------------------------
time:   00:54:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016532/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016532/
sentry: https://sentry.ceph.com/organizations/ceph/?query=20fb51640aa64f03bc0814fb7c694b7f

    Command failed on smithi137 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016536]  rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:55:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016536/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016536/
sentry: https://sentry.ceph.com/organizations/ceph/?query=42e31dd73de4420b8f2768ca4db4ff15

    Command failed on smithi053 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016540]  rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016540/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016540/
sentry: https://sentry.ceph.com/organizations/ceph/?query=481054f4a23b4850ae3834d5275cf375

    Command failed on smithi132 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016544]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:09:05
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016544/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016544/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a317d6b24404d5ea2fccd8ffd4fde1a

    Command failed on smithi115 with status 5: 'sudo systemctl stop
    ceph-f6985918-3012-11ed-8431-001a4aab830c@mon.smithi115'

[7016548]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   01:06:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016548/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016548/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13adb99f1cbd40fbb30895963b071321

    saw valgrind issues

[7016552]  rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
-----------------------------------------------------------------
time:   00:54:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016552/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016552/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5fe6ef207e6425492b10f6c463d19a7

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016556]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
-----------------------------------------------------------------
time:   00:58:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016556/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016556/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9cf781625d6f44c3b39a51d85a77ea32

    Command failed on smithi049 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016560]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:02:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016560/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016560/
sentry: https://sentry.ceph.com/organizations/ceph/?query=813d161599344d2ba1ac4bfd86d99eff

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016564]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}
-----------------------------------------------------------------
time:   00:54:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016564/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016564/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dfad4d90fb23419c99fa1da8aa2d251a

    Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016569]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/module_selftest}
-----------------------------------------------------------------
time:   01:01:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016569/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016569/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0b6604603e014f958bfe0763a4cf06e5

    Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016572]  rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016572/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016572/
sentry: https://sentry.ceph.com/organizations/ceph/?query=db3048a0eb154d2488a70ff7f47e9c57

    Command failed on smithi105 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016576]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:13:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016576/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016576/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a9c960037d44257b2428e06a4256c9c

    Command failed on smithi027 with status 5: 'sudo systemctl stop
    ceph-79bb505a-3015-11ed-8431-001a4aab830c@mon.a'

[7016580]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:55:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016580/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016580/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce651a3cc1e647a285f72755526db067

    Command failed on smithi081 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016592]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   01:05:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016592/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016592/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe3f83290f794cc0897589e6f11ae812

    saw valgrind issues

[7016596]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   01:01:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016596/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016596/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e053ab8d39e9404a8715fb7447074626

    Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016600]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps}
-----------------------------------------------------------------
time:   00:56:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016600/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016600/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8e581e2766974c1b944086ffecf20a4c

    Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016603]  rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:03:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016603/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016603/
sentry: https://sentry.ceph.com/organizations/ceph/?query=815c47714697410abc5b027a0e9be834

    Command failed on smithi176 with status 5: 'sudo systemctl stop
    ceph-0eab0ca6-3015-11ed-8431-001a4aab830c@mon.a'

[7016607]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced}
-----------------------------------------------------------------
time:   00:55:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016607/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016607/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6e9df164de924af59d998c5b5c64e993

    Command failed on smithi003 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016611]  rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:31
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016611/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016611/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d0f6c064235e4652bcccbf531dc455f3

    Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016616]  rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016616/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016616/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a19bd16940bc4bf2a74ef4699373f12e

    Command failed on smithi116 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016619]  rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:16
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016619/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016619/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40244af676e544fe97fe8d0c89fc6071

    Command failed on smithi106 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016623]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced}
-----------------------------------------------------------------
time:   00:56:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016623/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=012e4699499541fe9f48393d76d455d9

    Command failed on smithi085 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016627]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   01:01:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016627/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016627/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1448ef7e4084465eb9652301f92e013e

    Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016631]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
-----------------------------------------------------------------
time:   00:55:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016631/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016631/
sentry: https://sentry.ceph.com/organizations/ceph/?query=403bb3f21d474517a4301bf30ac0db42

    Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016639]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
-----------------------------------------------------------------
time:   00:54:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016639/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016639/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1539a040284c48709fd19dc17274f4a2

    Command failed on smithi153 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016643]  rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016643/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016643/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ccfa998b9c904b93a323f38ce31ca941

    Command failed on smithi112 with status 1: 'sudo ceph config set mgr
    mgr/devicehealth/enable_monitoring false --force'

[7016646]  rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016646/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016646/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0eb2efe5438940bfbcbc313d8bb8e5ad

    Command failed on smithi181 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016651]  rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:54:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016651/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016651/
sentry: https://sentry.ceph.com/organizations/ceph/?query=965229d7d76a4dfb84f5dddc079f21c0

    Command failed on smithi007 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016655]  rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016655/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016655/
sentry: https://sentry.ceph.com/organizations/ceph/?query=146fbc1fe28641e488831ac8909da48f

    Command failed on smithi190 with status 5: 'sudo systemctl stop
    ceph-e1badf94-3016-11ed-8431-001a4aab830c@mon.smithi190'

[7016659]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:56:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016659/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016659/
sentry: https://sentry.ceph.com/organizations/ceph/?query=823c4d1e559e4a12a3466eaabac3d8e1

    Command failed on smithi176 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016662]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:06:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016662/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016662/
sentry: https://sentry.ceph.com/organizations/ceph/?query=23dc325217b540ceb148fdc87a69bcf3

    Command failed on smithi044 with status 5: 'sudo systemctl stop
    ceph-09d636ea-3017-11ed-8431-001a4aab830c@mon.a'

[7016666]  rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016666/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016666/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9920cf07afc49d694d967eb9570988c

    Command failed on smithi049 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016670]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
-----------------------------------------------------------------
time:   00:56:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016670/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016670/
sentry: https://sentry.ceph.com/organizations/ceph/?query=57a8afc81ed34ea6ada550833a29ce65

    Command failed on smithi043 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016674]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:03:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016674/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016674/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1922f24104d54a95b2b6d6360b2da7e1

    Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016678]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925}
-----------------------------------------------------------------
time:   00:56:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016678/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016678/
sentry: https://sentry.ceph.com/organizations/ceph/?query=371096cd64c5458bb6363e5506cff7c7

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016682]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:04:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016682/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016682/
sentry: https://sentry.ceph.com/organizations/ceph/?query=908c6392f7034922a15d6aa1de602d58

    Command failed on smithi057 with status 5: 'sudo systemctl stop
    ceph-1287be80-3017-11ed-8431-001a4aab830c@mon.a'

[7016686]  rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016686/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016686/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7b4a149dd564b948d616c001e723bc4

    Command failed on smithi201 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016690]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache}
-----------------------------------------------------------------
time:   00:56:50
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016690/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016690/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d23cc15dcb1846a3b2080eba21f80812

    Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016694]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/progress}
-----------------------------------------------------------------
time:   01:02:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016694/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016694/
sentry: https://sentry.ceph.com/organizations/ceph/?query=93314a4fbba64eac9bd7e439962ab4bd

    Command failed on smithi027 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016698]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   01:02:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016698/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016698/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d82fac4cf0d54a498e06384612d689f4

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016702]  rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016702/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016702/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c08e69f31854836847a10c82106ef82

    Command failed on smithi006 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016706]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:13:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016706/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016706/

    SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC
    msg=audit(1662711725.134:7297): avc:  denied  { ioctl } for  pid=58937
    comm="iptables" path="/var/lib/containers/storage/overlay/e9c73c1803b9b5d4b
    d387abad8e81a68defac6c4721ac78491b86dd1a4119fd1/merged" dev="overlay"
    ino=3281397 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1', 'type=AVC msg=audit(1662711725.109:7296): avc:  denied  {
    ioctl } for  pid=58933 comm="iptables" path="/var/lib/containers/storage/ov
    erlay/e9c73c1803b9b5d4bd387abad8e81a68defac6c4721ac78491b86dd1a4119fd1/merg
    ed" dev="overlay" ino=3281397 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1']

[7016710]  rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016710/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016710/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9d8fdbb96a749a49000477f3fc87680

    Command failed on smithi102 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016718]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed}
-----------------------------------------------------------------
time:   01:02:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016718/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016718/
sentry: https://sentry.ceph.com/organizations/ceph/?query=278010649c6340e688bfdaa6c45330a3

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016722]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread}
-----------------------------------------------------------------
time:   01:00:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016722/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016722/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2e00834d20bf44e2aa545ca09b9c7fd8

    Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016726]  rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
-----------------------------------------------------------------
time:   00:54:54
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016726/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016726/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eaabf16a8595431c96d5c261a472971a

    Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016730]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read}
-----------------------------------------------------------------
time:   00:56:54
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016730/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016730/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e63d70d0a9ba4edfa3fd171e4c69bb51

    Command failed on smithi142 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016737]  rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016737/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016737/
sentry: https://sentry.ceph.com/organizations/ceph/?query=460eb5cba2234e07b4c07a91e0e50969

    Command failed on smithi017 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016742]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:04:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016742/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016742/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e170540630964b558829139e98d83a17

    Command failed on smithi046 with status 5: 'sudo systemctl stop
    ceph-d2eb26a8-3017-11ed-8431-001a4aab830c@mon.smithi046'

[7016746]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016746/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016746/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a2042e374dc4e149cf49ed3a3ae2cbe

    Command failed on smithi033 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016750]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:55:23
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016750/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016750/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5848f6eb2f9413b9539a43d4b5a9d54

    Command failed on smithi087 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016754]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps}
-----------------------------------------------------------------
time:   00:56:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016754/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016754/
sentry: https://sentry.ceph.com/organizations/ceph/?query=75c0479a391f4f7483dc4303a06ea949

    Command failed on smithi152 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016759]  rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016759/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016759/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8dac75045d314e82b7c648ca5961ce9c

    Command failed on smithi179 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016763]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
-----------------------------------------------------------------
time:   01:01:38
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016763/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016763/
sentry: https://sentry.ceph.com/organizations/ceph/?query=932f4bedd5214996a83c83f68843a478

    Command failed on smithi190 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016767]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:04:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016767/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016767/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2eaaa0053b845e1a645e77581165e6d

    Command failed on smithi145 with status 5: 'sudo systemctl stop
    ceph-7fc4762c-3018-11ed-8431-001a4aab830c@mon.a'

[7016771]  rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016771/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016771/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ccf9a7be84e6450d936cd8153228799c

    Command failed on smithi163 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016775]  rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   01:01:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016775/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016775/
sentry: https://sentry.ceph.com/organizations/ceph/?query=29ccac88c3794d72b33f8d13ee22564d

    Command failed on smithi093 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016779]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects}
-----------------------------------------------------------------
time:   00:55:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016779/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016779/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0fd4d89cb7054533b443c1b7ccf48ee3

    Command failed on smithi160 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016783]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/dashboard}
-----------------------------------------------------------------
time:   00:56:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016783/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016783/
sentry: https://sentry.ceph.com/organizations/ceph/?query=369e0309b61f4da1b51a161d13c807b7

    Command failed on smithi057 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016787]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:04:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016787/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016787/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8308e25d8cb74e1aa7133d4c2463016b

    Command failed on smithi044 with status 1: 'kubectl apply -f
    https://docs.projectcalico.org/manifests/tigera-operator.yaml'

[7016791]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:55:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016791/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016791/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce5c397cdbf044b2b0084b4561b39c2f

    Command failed on smithi161 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016803]  rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:46
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016803/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016803/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70675f1211f94340a242fe13ec145781

    Command failed on smithi089 with status 1: 'sudo ceph config set mgr
    mgr/devicehealth/enable_monitoring false --force'

[7016807]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:06:25
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016807/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016807/
sentry: https://sentry.ceph.com/organizations/ceph/?query=963713bf9db942c094934e4d9d44e413

    saw valgrind issues

[7016811]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:02:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016811/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016811/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8692dd272b7146ae8106d4ef4a76f7db

    Command failed on smithi110 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016815]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:56:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016815/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016815/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c383060dda3e4bcca77ba2680d4bbd3e

    Command failed on smithi066 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016819]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
-----------------------------------------------------------------
time:   00:54:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016819/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016819/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2168f38d52ed4faeb498d5efc865124e

    Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016823]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:55:06
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016823/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016823/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9b5f7480feee4430aeed5e21a43371ab

    Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7016827]  rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:03:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016827/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016827/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a7479beccdfb4181b92bbcb0b402bd79

    Command failed on smithi119 with status 5: 'sudo systemctl stop
    ceph-f9a4f8c6-3019-11ed-8431-001a4aab830c@mon.smithi119'

[7016831]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}
-----------------------------------------------------------------
time:   00:55:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016831/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016831/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc75b97464e84450973efa362a31f47e

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables optimal'

[7016835]  rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016835/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016835/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2dc659b0b8274b2f8e20cf443e64aac6

    Command failed on smithi171 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016839]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:57:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016839/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016839/
sentry: https://sentry.ceph.com/organizations/ceph/?query=07d2008dac264fffa76ba448b88d0dcb

    Command failed on smithi044 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016843]  rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016843/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016843/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e48537101dea40b6ab0f2d2695891e32

    Command failed on smithi114 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016847]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/prometheus}
-----------------------------------------------------------------
time:   01:01:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016847/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016847/
sentry: https://sentry.ceph.com/organizations/ceph/?query=19b833dab454436f8933bc638e1ed238

    Command failed on smithi053 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016851]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:06:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016851/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016851/
sentry: https://sentry.ceph.com/organizations/ceph/?query=317f0f71cf344cc4a9eab7b991e237c6

    Command failed on smithi035 with status 5: 'sudo systemctl stop ceph-
    ebcd5f98-301b-11ed-8431-001a4aab830c@mon.a'

[7016855]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016855/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016855/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13da3c65bac747788b04fc17a7500fde

    Command failed on smithi078 with status 5: 'sudo systemctl stop
    ceph-868a81a6-301b-11ed-8431-001a4aab830c@mon.smithi078'

[7016863]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   01:01:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016863/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016863/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a946e0a108f24900933587c118d6e88a

    Command failed on smithi133 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016867]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes}
-----------------------------------------------------------------
time:   00:56:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016867/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016867/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0fa43fbd56394d059a654a1040227bdf

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016871]  rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016871/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016871/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c98ac3a95b04152b1afc8f9311dc7fb

    Command failed on smithi105 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016875]  rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon}
-----------------------------------------------------------------
time:   00:09:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016875/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016875/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d97ad21c345b40bcaddced3473b7d08d

    Command failed (workunit test mon/misc.sh) on smithi178 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=df0a97fa697d229e980ce85a2573fb5244e28996
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh'

[7016883]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:09:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016883/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016883/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4a258a3c8a9c49c3be9856dd6c841238

    Command failed on smithi134 with status 5: 'sudo systemctl stop
    ceph-96d86ba2-301d-11ed-8431-001a4aab830c@mon.a'

[7016886]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:55:12
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016886/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016886/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04b8b4d02b8e4fd797b699ecdc469a27

    Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016890]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:55:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016890/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016890/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f68a728983d24eeb99f1c11a212a1162

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016894]  rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:12
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016894/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016894/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40cff4cedd6449308905e7cc1229a7ab

    Command failed on smithi081 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016898]  rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:01:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016898/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016898/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aa4841209da54953a33ed2d30426ef17

    Command failed on smithi119 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016902]  rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
-----------------------------------------------------------------
time:   00:54:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016902/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016902/
sentry: https://sentry.ceph.com/organizations/ceph/?query=117d2d0c8d7f42a581e59a2e9ec3b364

    Command failed on smithi052 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016906]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:08:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016906/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016906/
sentry: https://sentry.ceph.com/organizations/ceph/?query=86073adfa2d94a5b94fee12422771dc4

    Command failed on smithi035 with status 5: 'sudo systemctl stop
    ceph-f393c468-301d-11ed-8431-001a4aab830c@mon.a'

[7016910]  rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:54:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016910/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016910/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d32ce1d60ed3497a8f98dda5947b43ec

    Command failed on smithi003 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016914]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test}
-----------------------------------------------------------------
time:   01:00:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016914/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016914/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ded5274af4b64207ae5dbb7e8da41641

    Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016918]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect}
-----------------------------------------------------------------
time:   00:55:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016918/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016918/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2421f0e70864120902fba514a72431f

    Command failed on smithi106 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016923]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:02:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016923/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016923/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3fcb9a1fd2eb4268aa40a8071d5a6597

    Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016927]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
-----------------------------------------------------------------
time:   00:56:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016927/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016927/
sentry: https://sentry.ceph.com/organizations/ceph/?query=147f226329ec4e0d9bafdfccb9c542f2

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016931]  rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016931/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016931/
sentry: https://sentry.ceph.com/organizations/ceph/?query=be5523e1208d49bcb7349188b8685583

    Command failed on smithi181 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016935]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   00:55:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016935/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016935/
sentry: https://sentry.ceph.com/organizations/ceph/?query=71406ec39be44e78aa2954c9d5ec1a53

    Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016939]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
-----------------------------------------------------------------
time:   00:12:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016939/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016939/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58720494fc4b4cca92e4ba18e40c43bb

    Command failed on smithi084 with status 5: 'sudo systemctl stop
    ceph-e017c05c-2fcc-11ed-8431-001a4aab830c@mon.a'

[7016947]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
-----------------------------------------------------------------
time:   00:56:35
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016947/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016947/
sentry: https://sentry.ceph.com/organizations/ceph/?query=46968d47610d4e9891984eb7af479cee

    Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016951]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests}
-----------------------------------------------------------------
time:   01:02:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016951/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016951/
sentry: https://sentry.ceph.com/organizations/ceph/?query=591065244e3248518486170070b92afd

    Command failed on smithi040 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016955]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:55:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016955/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016955/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4af9d1707afd478e97cc3e0db75af0b0

    Command failed on smithi007 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016959]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:03:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016959/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016959/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7606ee3a04a745b0a29eea70c87bd5b5

    Command failed on smithi143 with status 5: 'sudo systemctl stop
    ceph-07e4ac9c-301f-11ed-8431-001a4aab830c@mon.smithi143'

[7016963]  rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016963/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016963/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f517aee1705245f6a8aceda03ad50311

    Command failed on smithi154 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016967]  rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016967/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016967/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d0c82eeb78224a98977be3d3474a5c0f

    Command failed on smithi134 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016971]  rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016971/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016971/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ae7578f23f3e4f83bec06ee19ecae78d

    Command failed on smithi178 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7016975]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/workunits}
-----------------------------------------------------------------
time:   00:54:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016975/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016975/
sentry: https://sentry.ceph.com/organizations/ceph/?query=03c59315471e41ab8a97dc3c1483dc5a

    Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016980]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects}
-----------------------------------------------------------------
time:   00:55:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016980/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016980/
sentry: https://sentry.ceph.com/organizations/ceph/?query=682dc95c53fd4e8d8a3a445538298205

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016983]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object}
-----------------------------------------------------------------
time:   00:56:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016983/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016983/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d87469d883dd4121a46e9b30a7b4b6e0

    Command failed on smithi102 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016987]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:09:30
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016987/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016987/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a8e516a38d76499e878e9f2c6ed6a762

    Command failed on smithi107 with status 5: 'sudo systemctl stop ceph-
    ac01e9f6-3020-11ed-8431-001a4aab830c@mon.a'

[7016991]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
-----------------------------------------------------------------
time:   00:54:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016991/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016991/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5aec5a81c1074c30974ee3778dc5ac89

    Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7016995]  rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:43
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016995/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016995/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5446d21f7214ddfa3906bbd5ac6a028

    Command failed on smithi006 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017000]  rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017000/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017000/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a2ea2b7a55445a69363353701e1dfbb

    Command failed on smithi165 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017008]  rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
-----------------------------------------------------------------
time:   01:06:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017008/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017008/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8026b053dfd24af6961d059230b3702e

    Command failed on smithi049 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017012]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:55:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017012/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017012/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b4612c7ab43242a1ad136bc1e9de9601

    Command failed on smithi087 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017016]  rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:05:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017016/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017016/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c036342e1e143fe955a25c24dfff7c6

    Command failed on smithi201 with status 5: 'sudo systemctl stop
    ceph-24023546-3021-11ed-8431-001a4aab830c@mon.a'

[7017020]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test}
-----------------------------------------------------------------
time:   00:55:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017020/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017020/
sentry: https://sentry.ceph.com/organizations/ceph/?query=53bfa24753064070929ca7ad397355a6

    Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017024]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read}
-----------------------------------------------------------------
time:   00:55:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017024/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017024/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd670ebc4cae4fd3962d9e416037dd24

    Command failed on smithi033 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017028]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017028/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017028/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8a9d442c1d1a4f7283ccc880bdf51068

    Command failed on smithi090 with status 5: 'sudo systemctl stop
    ceph-28d0c506-3021-11ed-8431-001a4aab830c@mon.a'

[7017032]  rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:10
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017032/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017032/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f8a4d122f6ac4597af0ab4f2d33cb897

    Command failed on smithi104 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017036]  rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:55:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017036/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017036/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0cfa079c635542c1a2c1d502769c5032

    Command failed on smithi038 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017040]  rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017040/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017040/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99b12952258f43bc962d2a2a15919f93

    Command failed on smithi130 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017044]  rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:03:13
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017044/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017044/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e2c281b283e947d98aac05bf9d4de558

    Command failed on smithi070 with status 5: 'sudo systemctl stop
    ceph-23fe8e32-3021-11ed-8431-001a4aab830c@mon.a'

[7017048]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:03:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017048/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017048/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2bb205062bf243af811a6541cddc1290

    Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017052]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:55:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017052/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017052/
sentry: https://sentry.ceph.com/organizations/ceph/?query=16392a83d17a409293a38d2aa9188c1e

    Command failed on smithi192 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017056]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced}
-----------------------------------------------------------------
time:   01:01:58
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017056/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017056/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5b1e4f9b59f4b1fa37f6bbce3543144

    Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7017060]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:06:58
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017060/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017060/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4eb40f454a9e40ceb30b4698a02ebe11

    saw valgrind issues

[7017064]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   01:02:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017064/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017064/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a147607f35824961b6780e2fb3ea669c

    Command failed on smithi057 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017068]  rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017068/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017068/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a038d588d06e45deb48ec2b66056be8a

    Command failed on smithi071 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017072]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:09:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017072/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017072/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5faf2d7b9808414097e354acaa13d8fc

    Command failed on smithi089 with status 5: 'sudo systemctl stop
    ceph-6afc107e-3022-11ed-8431-001a4aab830c@mon.smithi089'

[7017076]  rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017076/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017076/
sentry: https://sentry.ceph.com/organizations/ceph/?query=83772a01b7454826aaaa78490db8146a

    Command failed on smithi139 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017080]  rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
-----------------------------------------------------------------
time:   00:54:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017080/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017080/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99cfcb0decf54a9ca767f6cb2f6ba04d

    Command failed on smithi093 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017089]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   01:02:03
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017089/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017089/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f71d8f238e7c47efa5d11562fe262c17

    Command failed on smithi107 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017093]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized}
-----------------------------------------------------------------
time:   00:55:06
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017093/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017093/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a464c0b6f47446f6b44efecc36d8616f

    Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7017097]  rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017097/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017097/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ace8065b6e488b96bfdb62a29cbff0

    Command failed on smithi149 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017101]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:07:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017101/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017101/
sentry: https://sentry.ceph.com/organizations/ceph/?query=914ce12ff95b45268c84a58678400e2c

    Command failed on smithi090 with status 5: 'sudo systemctl stop
    ceph-34c563ce-3023-11ed-8431-001a4aab830c@mon.a'

[7017105]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
-----------------------------------------------------------------
time:   00:55:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017105/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017105/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c54673dbb9674b9aa08b7cd8beb48401

    Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017108]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e}
-----------------------------------------------------------------
time:   00:07:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017108/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017108/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e17768cdf1e74c6690ac32e192e306e6

    Command failed on smithi066 with status 5: 'sudo systemctl stop
    ceph-482f927c-3023-11ed-8431-001a4aab830c@mon.a'

[7017111]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/crash}
-----------------------------------------------------------------
time:   00:56:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017111/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017111/
sentry: https://sentry.ceph.com/organizations/ceph/?query=37688632b29540c4849b76c807bf7099

    Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017114]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:04:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017114/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017114/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d528faec162b4a47b86709d7025b6269

    Command failed on smithi159 with status 1: 'kubectl apply -f
    https://docs.projectcalico.org/manifests/tigera-operator.yaml'

[7017116]  rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017116/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017116/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ceb1534d9904e728b93442c5eade387

    Command failed on smithi110 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017119]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/libcephsqlite}
-----------------------------------------------------------------
time:   00:55:28
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017119/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017119/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25b57a16b2fc4530b9e0a9b6c7203676

    Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017122]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects}
-----------------------------------------------------------------
time:   00:55:02
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017122/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017122/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a09129012a55495e91b66f7a61c67369

    Command failed on smithi137 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables jewel'

[7017125]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   00:55:15
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017125/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017125/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9238a8d101774767af07539a905e33d5

    Command failed on smithi089 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017128]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:04:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017128/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017128/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ca217eeea184c699e6d6220384f6d3e

    Command failed on smithi044 with status 5: 'sudo systemctl stop
    ceph-f183075a-3023-11ed-8431-001a4aab830c@mon.a'

[7017132]  rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017132/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017132/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54ac67f02d5144baa42d885d01011fc6

    Command failed on smithi114 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017135]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   01:01:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017135/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017135/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e4c5767392194c959e5a23300382ef4c

    Command failed on smithi053 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017137]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   01:00:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017137/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017137/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d838dc9c36474f6da11ba7817699f58f

    Command failed on smithi164 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017143]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced}
-----------------------------------------------------------------
time:   00:56:06
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017143/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017143/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f348844faee5410aaa2b69e692bba26d

    Command failed on smithi179 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017146]  rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:08:58
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017146/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017146/
sentry: https://sentry.ceph.com/organizations/ceph/?query=232d74bd3ffb4933b601c59e34cf96cc

    Command failed on smithi145 with status 5: 'sudo systemctl stop
    ceph-6f8c8134-3025-11ed-8431-001a4aab830c@mon.smithi145'

[7017149]  rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017149/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ad5b43d0abb4aaf836488250d1d11e7

    Command failed on smithi099 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017152]  rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   01:01:40
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017152/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017152/
sentry: https://sentry.ceph.com/organizations/ceph/?query=73430f5233a64f748d182155c5c6788c

    Command failed on smithi044 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017155]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
-----------------------------------------------------------------
time:   00:54:44
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017155/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017155/
sentry: https://sentry.ceph.com/organizations/ceph/?query=64acaff650014828a38fcb50eb0fc150

    Command failed on smithi083 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017158]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   01:02:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017158/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017158/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2026034675c8493585f8320e36bdc287

    Command failed on smithi078 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017161]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:56:34
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017161/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017161/
sentry: https://sentry.ceph.com/organizations/ceph/?query=379c5ec8b23742aebabf1976f7c91546

    Command failed on smithi174 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017164]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:16:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017164/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017164/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c05be9ac6d1d473ba9dc09dfcedf0f23

    Command failed on smithi059 with status 5: 'sudo systemctl stop
    ceph-64521ec2-3026-11ed-8431-001a4aab830c@mon.smithi059'

[7017167]  rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:14
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017167/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=359a163b91dd4f33bff5e5dfb16b7ea4

    Command failed on smithi050 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017170]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized}
-----------------------------------------------------------------
time:   01:02:04
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017170/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017170/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3660f33e658f4030bb4fc739ee25045d

    Command failed on smithi003 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017173]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   01:01:23
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017173/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017173/
sentry: https://sentry.ceph.com/organizations/ceph/?query=26d23d1698154dea8ecbac608503eb09

    Command failed on smithi133 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017176]  rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:12
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017176/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017176/
sentry: https://sentry.ceph.com/organizations/ceph/?query=226ac034ad3846b7990f3d90bc0398d9

    Command failed on smithi105 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017182]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:06:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017182/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017182/
sentry: https://sentry.ceph.com/organizations/ceph/?query=db1baa85bd6a42ed93cbe74db004e628

    Command failed on smithi106 with status 5: 'sudo systemctl stop
    ceph-240f9b18-3027-11ed-8431-001a4aab830c@mon.a'

[7017188]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:56:22
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017188/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017188/
sentry: https://sentry.ceph.com/organizations/ceph/?query=77a7646309814e65ada53db8f65bc6ea

    Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017191]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests}
-----------------------------------------------------------------
time:   01:00:01
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017191/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017191/
sentry: https://sentry.ceph.com/organizations/ceph/?query=363b3c5f35874f51aba4fd74418f2871

    Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017194]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:55:09
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017194/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017194/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c22779c6cffd437f8f81858f7bfde364

    Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017200]  rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:11
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017200/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017200/
sentry: https://sentry.ceph.com/organizations/ceph/?query=05eef3afa43e4e15bf3eb232a5946067

    Command failed on smithi115 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017203]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:03:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017203/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017203/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6541fa103d7c4440b0e624febe0ee11d

    Command failed on smithi150 with status 5: 'sudo systemctl stop
    ceph-5097ae96-3027-11ed-8431-001a4aab830c@mon.a'

[7017206]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
-----------------------------------------------------------------
time:   00:55:06
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017206/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017206/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c70f0cb46664668920ebb2a0a2e792b

    Command failed on smithi088 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017209]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed}
-----------------------------------------------------------------
time:   00:55:17
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017209/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017209/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08cad8448b32470a8f689f2d0675932e

    Command failed on smithi080 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017211]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/failover}
-----------------------------------------------------------------
time:   00:56:26
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017211/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017211/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c9981477ff44ad9b22777548de9f35a

    Command failed on smithi007 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017213]  rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:54:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017213/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e85205b85fe42ed9dd3d4fe857ac823

    Command failed on smithi035 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017215]  rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:07
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017215/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017215/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b0de5d66beb645d7b9ddcb384b760bcf

    Command failed on smithi154 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017217]  rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
-----------------------------------------------------------------
time:   00:54:37
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017217/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017217/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0911777ba68c413daaa660874aee8d98

    Command failed on smithi063 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017219]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:54:55
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017219/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017219/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4041a0f2b4644c2183a5425b487d2469

    Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017221]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:19:04
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017221/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017221/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f4742c562c8451685e39749cdeff001

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi040 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=df0a97fa697d229e980ce85a2573fb5244e28996
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7017223]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests}
-----------------------------------------------------------------
time:   00:56:53
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017223/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5e00ecd127d44a2a97a5eb842c3ed83

    Command failed on smithi006 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[7017225]  rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:54:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017225/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017225/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af22969fdd864e6da17a8c6683f6771f

    Command failed on smithi119 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017227]  rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:56:08
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017227/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017227/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe996fbba89d445daf324be8e0142077

    Command failed on smithi106 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'

[7017229]  rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:55:57
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017229/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017229/
sentry: https://sentry.ceph.com/organizations/ceph/?query=885dc14268774aa4ae1558caac8aebab

    Command failed on smithi134 with status 1: 'sudo ceph config set mgr
    mgr_pool false --force'



Dead
=================================================================
[7016163]  rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016163/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016163/

    hit max job timeout

[7016795]  rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016795/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016795/

    hit max job timeout



Pass
=================================================================
[7016025] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}}
time:   00:34:48
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016025/

[7016069] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption}
time:   00:14:32
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016069/

[7016159] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c}
time:   00:12:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016159/

[7016171] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm}
time:   00:18:59
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016171/

[7016269] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:03:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016269/

[7016294] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:06:39
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016294/

[7016298] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush}
time:   00:17:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016298/

[7016448] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code}
time:   01:26:24
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016448/

[7016584] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:45
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016584/

[7016588] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr}
time:   00:13:36
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016588/

[7016635] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption}
time:   00:06:56
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016635/

[7016714] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc}
time:   01:04:00
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016714/

[7016734] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}}
time:   00:05:19
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016734/

[7016799] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos}
time:   00:04:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016799/

[7016859] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}}
time:   00:11:47
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016859/

[7016879] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:06:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016879/

[7016943] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:11:33
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7016943/

[7017003] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill}
time:   04:18:52
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017003/

[7017084] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}}
time:   02:14:27
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017084/

[7017140] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd}
time:   03:18:41
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017140/

[7017179] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}}
time:   02:14:21
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017179/

[7017185] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   00:08:20
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017185/

[7017197] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:54
info:   http://pulpito.ceph.com/yuriw-2022-09-07_00:06:35-rados-wip-yuri4-testing-2022-09-06-1408-distro-default-smithi/7017197/