2022-06-12T08:42:05.736 INFO:root:teuthology version: 1.1.1.dev370+g2290146e 2022-06-12T08:42:05.737 INFO:teuthology.results:subset: '15764/100000' 2022-06-12T08:42:05.738 INFO:teuthology.results:seed: '4151' 2022-06-12T10:48:07.555 INFO:root:teuthology version: 1.1.1.dev370+g2290146e 2022-06-12T10:48:07.589 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-12T14:06:24.337 INFO:teuthology.results:Tests finished! gathering results... 2022-06-12T14:06:44.407 INFO:scrape:Found 309 jobs 2022-06-12T14:06:45.199 INFO:scrape:Found 3 distinct failure reasons 2022-06-12T14:06:45.200 INFO:scrape:Failure: 'wait for operator' reached maximum tries (90) after waiting for 900 seconds 2022-06-12T14:06:45.201 INFO:scrape:5 jobs: ['6875595', '6875519', '6875365', '6875485', '6875440'] 2022-06-12T14:06:45.201 INFO:scrape:suites intersection: [] 2022-06-12T14:06:45.202 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'clusters/{fixed-2', 'fast/fast', 'k8s/1.21', 'mon_election/classic', 'msgr-failures/osd-delay', 'net/calico', 'net/flannel', 'net/host', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-radosbench}'] 2022-06-12T14:06:45.202 INFO:scrape: 2022-06-12T14:06:45.203 INFO:scrape:Crash: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_msgr' 2022-06-12T14:06:45.203 INFO:scrape:ceph version 17.2.0-434-g9c59f57d (9c59f57df6b60922a0810152a42e8734514d99c7) quincy (stable) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fcf2b0f2420] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b7) [0x7fcf2a5bb834] 5: /usr/lib/ceph/libceph-common.so.2(+0x27c9de) [0x7fcf2a5bb9de] 6: /usr/lib/ceph/libceph-common.so.2(+0x5e10d9) [0x7fcf2a9200d9] 7: (AsyncMessenger::~AsyncMessenger()+0xd) [0x7fcf2a9200ed] 8: (MessengerTest::TearDown()+0x111) [0x558ea9bfdb41] 9: (void testing::internal::HandleExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*)+0x51) [0x558ea9c508f1] 10: (testing::TestInfo::Run()+0x135) [0x558ea9c43155] 11: (testing::TestSuite::Run()+0xc9) [0x558ea9c436e9] 12: (testing::internal::UnitTestImpl::RunAllTests()+0x487) [0x558ea9c43d17] 13: (bool testing::internal::HandleExceptionsInMethodIfSupported(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*)+0x51) [0x558ea9c50e61] 14: (testing::UnitTest::Run()+0xa1) [0x558ea9c43221] 15: main() 16: __libc_start_main() 17: _start() 2022-06-12T14:06:45.204 INFO:scrape:1 jobs: ['6875489'] 2022-06-12T14:06:45.204 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/msgr', 'supported-random-distro$/{ubuntu_latest}}'] 2022-06-12T14:06:45.205 INFO:scrape: 2022-06-12T14:06:45.205 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9c59f57df6b60922a0810152a42e8734514d99c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-06-12T14:06:45.205 INFO:scrape:2 jobs: ['6875616', '6875463'] 2022-06-12T14:06:45.206 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2022-06-12T14:06:45.206 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-zlib}', 'tasks/e2e}'] 2022-06-12T14:06:45.207 INFO:scrape: 2022-06-12T14:06:45.216 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/ failed: 8 dead: 0 running: 0 waiting: 0 queued: 0 passed: 301 Fail ================================================================= [6875365] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875365/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875365/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9663778d80714328b5bbb8e58a970d58 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6875440] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:19:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875440/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf0cac1d6129486980e4212b0e6ec49c 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6875463] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875463/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875463/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93f74a88e2f946af802cf8b19a3112be Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9c59f57df6b60922a0810152a42e8734514d99c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6875485] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 02:38:50 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875485/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26ad67bbb5d54b24b1e2d2788bfa62ba reached maximum tries (800) after waiting for 4800 seconds [6875489] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:04:46 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875489/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea050a7fef7342b38e54affcc6af1bfe Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_msgr' [6875519] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875519/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80a896aa228440c59fe981b7cfbf7bd6 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6875595] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a61c5f882fc458cb2412644eaf0ba61 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6875616] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875616/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875616/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be0c9718870f4f489470c3169254d6b9 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9c59f57df6b60922a0810152a42e8734514d99c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' Pass ================================================================= [6875338] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875338/ [6875339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875339/ [6875340] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875340/ [6875341] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:44:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875341/ [6875342] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875342/ [6875343] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/progress} time: 00:22:30 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875343/ [6875344] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:27:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875344/ [6875345] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875345/ [6875346] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875346/ [6875347] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875347/ [6875348] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875348/ [6875349] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875349/ [6875350] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875350/ [6875351] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875351/ [6875352] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875352/ [6875353] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:29 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875353/ [6875354] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875354/ [6875355] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} time: 00:31:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875355/ [6875356] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875356/ [6875357] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875357/ [6875358] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875358/ [6875359] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:31:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875359/ [6875360] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875360/ [6875361] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:17:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875361/ [6875362] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:26:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875362/ [6875363] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875363/ [6875364] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875364/ [6875366] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:56:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875366/ [6875367] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875367/ [6875368] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875368/ [6875369] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875369/ [6875370] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:11:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875370/ [6875371] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:23:43 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875371/ [6875372] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:06:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875372/ [6875373] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875373/ [6875374] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:43:56 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875374/ [6875375] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875375/ [6875376] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875376/ [6875377] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875377/ [6875378] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875378/ [6875379] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:21:56 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875379/ [6875380] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875380/ [6875381] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875381/ [6875382] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:55:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875382/ [6875383] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875383/ [6875384] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} time: 01:18:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875384/ [6875385] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875385/ [6875386] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:32:44 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875386/ [6875387] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875387/ [6875388] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:53:35 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875388/ [6875389] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:04:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875389/ [6875390] rados/singleton/{all/peer mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875390/ [6875391] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875391/ [6875392] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:25:43 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875392/ [6875393] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:46:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875393/ [6875394] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:46:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875394/ [6875395] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875395/ [6875396] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:19 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875396/ [6875397] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875397/ [6875398] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875398/ [6875399] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875399/ [6875400] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875400/ [6875401] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875401/ [6875402] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875402/ [6875403] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 01:09:40 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875403/ [6875404] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:26:16 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875404/ [6875405] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875405/ [6875406] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875406/ [6875407] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875407/ [6875408] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875408/ [6875409] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:32:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875409/ [6875410] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875410/ [6875411] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875411/ [6875412] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:23 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875412/ [6875413] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875413/ [6875414] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875414/ [6875415] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:24:27 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875415/ [6875416] rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875416/ [6875417] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875417/ [6875418] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:37 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875418/ [6875419] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} time: 00:39:14 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875419/ [6875420] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875420/ [6875421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:43:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875421/ [6875422] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875422/ [6875423] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875423/ [6875424] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:27:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875424/ [6875425] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875425/ [6875426] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875426/ [6875427] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875427/ [6875428] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875428/ [6875429] rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875429/ [6875430] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:21:16 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875430/ [6875431] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875431/ [6875432] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875432/ [6875433] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875433/ [6875434] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875434/ [6875435] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} time: 04:36:23 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875435/ [6875436] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875436/ [6875437] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875437/ [6875438] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875438/ [6875439] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875439/ [6875441] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875441/ [6875442] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875442/ [6875443] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875443/ [6875444] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:39:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875444/ [6875445] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875445/ [6875446] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875446/ [6875447] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875447/ [6875448] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875448/ [6875449] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875449/ [6875450] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875450/ [6875451] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875451/ [6875452] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:33:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875452/ [6875453] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875453/ [6875454] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:36:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875454/ [6875455] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875455/ [6875456] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875456/ [6875457] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} time: 00:45:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875457/ [6875458] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} time: 02:06:57 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875458/ [6875459] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875459/ [6875460] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875460/ [6875461] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875461/ [6875462] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875462/ [6875464] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875464/ [6875465] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875465/ [6875466] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875466/ [6875467] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875467/ [6875468] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875468/ [6875469] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875469/ [6875470] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:24:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875470/ [6875471] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875471/ [6875472] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875472/ [6875473] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875473/ [6875474] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875474/ [6875475] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/failover} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875475/ [6875476] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875476/ [6875477] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875477/ [6875478] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:23 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875478/ [6875479] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/many workloads/pool-create-delete} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875479/ [6875480] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875480/ [6875481] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875481/ [6875482] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875482/ [6875483] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 02:14:04 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875483/ [6875484] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 01:16:38 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875484/ [6875486] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875486/ [6875487] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875487/ [6875488] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875488/ [6875490] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875490/ [6875491] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:25:45 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875491/ [6875492] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:46 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875492/ [6875493] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875493/ [6875494] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875494/ [6875495] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875495/ [6875496] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:42:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875496/ [6875497] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875497/ [6875498] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875498/ [6875499] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:03:56 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875499/ [6875500] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875500/ [6875501] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875501/ [6875502] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875502/ [6875503] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:28:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875503/ [6875504] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875504/ [6875505] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:43:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875505/ [6875506] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875506/ [6875507] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875507/ [6875508] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875508/ [6875509] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/insights} time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875509/ [6875510] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875510/ [6875511] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875511/ [6875512] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}} time: 00:42:22 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875512/ [6875513] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:27 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875513/ [6875514] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875514/ [6875515] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:33:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875515/ [6875516] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:21:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875516/ [6875517] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:34 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875517/ [6875518] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875518/ [6875520] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875520/ [6875521] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875521/ [6875522] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:41:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875522/ [6875523] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:07:18 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875523/ [6875524] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875524/ [6875525] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:39:52 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875525/ [6875526] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875526/ [6875527] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875527/ [6875528] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875528/ [6875529] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875529/ [6875530] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875530/ [6875531] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875531/ [6875532] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875532/ [6875533] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875533/ [6875534] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:02 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875534/ [6875535] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875535/ [6875536] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} time: 01:17:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875536/ [6875537] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:41:17 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875537/ [6875538] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875538/ [6875539] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875539/ [6875540] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875540/ [6875541] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875541/ [6875542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} time: 00:38:27 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875542/ [6875543] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:12 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875543/ [6875544] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:29:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875544/ [6875545] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875545/ [6875546] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875546/ [6875547] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:46:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875547/ [6875548] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875548/ [6875549] rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875549/ [6875550] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875550/ [6875551] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875551/ [6875552] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875552/ [6875553] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875553/ [6875554] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875554/ [6875555] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875555/ [6875556] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875556/ [6875557] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:17:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875557/ [6875558] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875558/ [6875559] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875559/ [6875560] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875560/ [6875561] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875561/ [6875562] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875562/ [6875563] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875563/ [6875564] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875564/ [6875565] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875565/ [6875566] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875566/ [6875567] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875567/ [6875568] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875568/ [6875569] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875569/ [6875570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875570/ [6875571] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:54:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875571/ [6875572] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:53:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875572/ [6875573] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875573/ [6875574] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875574/ [6875575] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875575/ [6875576] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875576/ [6875577] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875577/ [6875578] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 01:56:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875578/ [6875579] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875579/ [6875580] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:53:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875580/ [6875581] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875581/ [6875582] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:29:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875582/ [6875583] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875583/ [6875584] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875584/ [6875585] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:53:36 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875585/ [6875586] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:35:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875586/ [6875587] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875587/ [6875588] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875588/ [6875589] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875589/ [6875590] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875590/ [6875591] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875591/ [6875592] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875592/ [6875593] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:59:46 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875593/ [6875594] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875594/ [6875596] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875596/ [6875597] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875597/ [6875598] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875598/ [6875599] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875599/ [6875600] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:24:21 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875600/ [6875601] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:52 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875601/ [6875602] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:37 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875602/ [6875603] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875603/ [6875604] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875604/ [6875605] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875605/ [6875606] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875606/ [6875607] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875607/ [6875608] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:24:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875608/ [6875609] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875609/ [6875610] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:38:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875610/ [6875611] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875611/ [6875612] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875612/ [6875613] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875613/ [6875614] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:03:50 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875614/ [6875615] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:45:35 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875615/ [6875617] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875617/ [6875618] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875618/ [6875619] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:23:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875619/ [6875620] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875620/ [6875621] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875621/ [6875622] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875622/ [6875623] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:33:26 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875623/ [6875624] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875624/ [6875625] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875625/ [6875626] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875626/ [6875627] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875627/ [6875628] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:45 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875628/ [6875629] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875629/ [6875630] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:37:47 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875630/ [6875631] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875631/ [6875632] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875632/ [6875633] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:40:15 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875633/ [6875634] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/many workloads/snaps-few-objects} time: 00:51:42 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875634/ [6875635] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875635/ [6875636] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875636/ [6875637] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:58 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875637/ [6875638] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:44:06 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875638/ [6875639] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:57:51 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875639/ [6875640] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875640/ [6875641] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:07:18 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875641/ [6875642] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875642/ [6875643] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875643/ [6875644] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875644/ [6875645] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875645/ [6875646] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2022-06-12_07:01:04-rados-quincy-distro-default-smithi/6875646/