2021-12-12T07:54:34.943 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-12T07:54:34.944 INFO:teuthology.results:subset: '31866/100000' 2021-12-12T07:54:34.945 INFO:teuthology.results:seed: '3698' 2021-12-12T10:36:56.774 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-12T10:36:56.821 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-12-12T22:20:03.514 INFO:teuthology.results:Tests finished! gathering results... 2021-12-12T22:20:41.061 INFO:scrape:Found 419 jobs 2021-12-12T22:20:43.490 INFO:scrape:Found 4 distinct failure reasons 2021-12-12T22:20:43.491 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi150.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2021-12-12T22:20:43.492 INFO:scrape:2 jobs: ['6559261', '6559053'] 2021-12-12T22:20:43.492 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2021-12-12T22:20:43.493 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2021-12-12T22:20:43.493 INFO:scrape: 2021-12-12T22:20:43.494 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8c4e9d665b795cde2ca4c5180b97a8f6c9e76214 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-12-12T22:20:43.494 INFO:scrape:2 jobs: ['6559316', '6559106'] 2021-12-12T22:20:43.495 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2021-12-12T22:20:43.495 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-stupid}', 'tasks/e2e}'] 2021-12-12T22:20:43.496 INFO:scrape: 2021-12-12T22:20:43.496 INFO:scrape:Failure: Exiting scrub checking -- not all pgs scrubbed. 2021-12-12T22:20:43.496 INFO:scrape:1 jobs: ['6559376'] 2021-12-12T22:20:43.497 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'supported-random-distro$/{ubuntu_latest}}'] 2021-12-12T22:20:43.497 INFO:scrape: 2021-12-12T22:20:43.498 INFO:scrape:Dead: b'2021-12-12T20:47:36.941 DEBUG:teuthology.exit:Finished running handlers' 2021-12-12T22:20:43.498 INFO:scrape:2 jobs: ['6559161', '6559370'] 2021-12-12T22:20:43.498 INFO:scrape:suites intersection: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2021-12-12T22:20:43.499 INFO:scrape:suites union: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2021-12-12T22:20:43.499 INFO:scrape: 2021-12-12T22:20:43.512 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/ failed: 5 dead: 2 running: 0 waiting: 0 queued: 0 passed: 412 Fail ================================================================= [6559053] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559053/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=497b3effa81f47aca0268f81882476d3 [Errno 2] Cannot find file on the remote 'ubuntu@smithi079.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6559106] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} ----------------------------------------------------------------- time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559106/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cc639f67a0f479182a5220df2b43afa Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8c4e9d665b795cde2ca4c5180b97a8f6c9e76214 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6559261] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559261/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6eecc48f0094c3a9de2c4f9031982bb [Errno 2] Cannot find file on the remote 'ubuntu@smithi150.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6559316] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559316/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f4c4620efa854952ac23e5c3e4840ba7 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8c4e9d665b795cde2ca4c5180b97a8f6c9e76214 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6559376] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:30:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559376/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559376/ Exiting scrub checking -- not all pgs scrubbed. Dead ================================================================= [6559161] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559161/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559161/ hit max job timeout [6559370] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559370/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559370/ hit max job timeout Pass ================================================================= [6559019] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559019/ [6559020] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559020/ [6559021] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559021/ [6559022] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559022/ [6559023] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559023/ [6559024] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559024/ [6559025] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559025/ [6559026] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559026/ [6559027] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559027/ [6559028] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559028/ [6559029] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:42:21 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559029/ [6559030] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/pool-create-delete} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559030/ [6559031] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559031/ [6559032] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559032/ [6559033] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} time: 00:44:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559033/ [6559034] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559034/ [6559035] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8.stream} tasks/failover} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559035/ [6559036] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559036/ [6559037] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559037/ [6559038] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559038/ [6559039] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559039/ [6559040] rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:47:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559040/ [6559041] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559041/ [6559042] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559042/ [6559043] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:24:57 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559043/ [6559044] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559044/ [6559045] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559045/ [6559046] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559046/ [6559047] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559047/ [6559048] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559048/ [6559049] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559049/ [6559050] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559050/ [6559051] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:33:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559051/ [6559052] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559052/ [6559054] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559054/ [6559055] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559055/ [6559056] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559056/ [6559057] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559057/ [6559058] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} time: 00:27:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559058/ [6559059] rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:56:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559059/ [6559060] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559060/ [6559061] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559061/ [6559062] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/insights} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559062/ [6559063] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559063/ [6559064] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559064/ [6559065] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:12:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559065/ [6559066] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559066/ [6559067] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559067/ [6559068] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559068/ [6559069] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559069/ [6559070] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:33:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559070/ [6559071] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559071/ [6559072] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:08:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559072/ [6559073] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559073/ [6559074] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559074/ [6559075] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559075/ [6559076] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:22 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559076/ [6559077] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559077/ [6559078] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559078/ [6559079] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559079/ [6559080] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559080/ [6559081] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:01:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559081/ [6559082] rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559082/ [6559083] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559083/ [6559084] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:23:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559084/ [6559085] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559085/ [6559086] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559086/ [6559087] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559087/ [6559088] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:30:50 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559088/ [6559089] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:46:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559089/ [6559090] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559090/ [6559091] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559091/ [6559092] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559092/ [6559093] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559093/ [6559094] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559094/ [6559095] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:49:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559095/ [6559096] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559096/ [6559097] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559097/ [6559098] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:38:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559098/ [6559099] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:56:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559099/ [6559100] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559100/ [6559101] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559101/ [6559102] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559102/ [6559103] rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559103/ [6559104] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:31:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559104/ [6559105] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559105/ [6559107] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559107/ [6559108] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559108/ [6559109] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:36:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559109/ [6559110] rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559110/ [6559111] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559111/ [6559112] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} time: 02:18:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559112/ [6559113] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559113/ [6559114] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559114/ [6559115] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559115/ [6559116] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:47:30 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559116/ [6559117] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:58:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559117/ [6559118] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559118/ [6559119] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559119/ [6559120] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559120/ [6559121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559121/ [6559122] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559122/ [6559123] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/progress} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559123/ [6559124] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559124/ [6559125] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559125/ [6559126] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559126/ [6559127] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559127/ [6559128] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559128/ [6559129] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559129/ [6559130] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} time: 00:30:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559130/ [6559131] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559131/ [6559132] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559132/ [6559133] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559133/ [6559134] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559134/ [6559135] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559135/ [6559136] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559136/ [6559137] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:32:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559137/ [6559138] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559138/ [6559139] rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559139/ [6559140] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559140/ [6559141] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559141/ [6559142] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559142/ [6559143] rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/mgr} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559143/ [6559144] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:26:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559144/ [6559145] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559145/ [6559146] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559146/ [6559147] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559147/ [6559148] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559148/ [6559149] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559149/ [6559150] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559150/ [6559151] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559151/ [6559152] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/prometheus} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559152/ [6559153] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559153/ [6559154] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559154/ [6559155] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559155/ [6559156] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:42:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559156/ [6559157] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/host rook/1.7.0} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559157/ [6559158] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559158/ [6559159] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:44:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559159/ [6559160] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559160/ [6559162] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559162/ [6559163] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559163/ [6559164] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559164/ [6559165] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559165/ [6559166] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:32:06 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559166/ [6559167] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:43:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559167/ [6559168] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559168/ [6559169] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559169/ [6559170] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:32:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559170/ [6559171] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559171/ [6559172] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559172/ [6559173] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559173/ [6559174] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559174/ [6559175] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559175/ [6559176] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559176/ [6559177] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559177/ [6559178] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559178/ [6559179] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559179/ [6559180] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559180/ [6559181] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:09:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559181/ [6559182] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/workunits} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559182/ [6559183] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:43 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559183/ [6559184] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:35:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559184/ [6559185] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559185/ [6559186] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559186/ [6559187] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559187/ [6559188] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559188/ [6559189] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:55:10 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559189/ [6559190] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:07:41 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559190/ [6559191] rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:43:49 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559191/ [6559192] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559192/ [6559193] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559193/ [6559194] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559194/ [6559195] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559195/ [6559196] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559196/ [6559197] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559197/ [6559198] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/pool-create-delete} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559198/ [6559199] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:43:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559199/ [6559200] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:57 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559200/ [6559201] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559201/ [6559202] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559202/ [6559203] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559203/ [6559204] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559204/ [6559205] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559205/ [6559206] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559206/ [6559207] rados/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559207/ [6559208] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559208/ [6559209] rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:49:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559209/ [6559210] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:12:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559210/ [6559211] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/crash} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559211/ [6559212] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559212/ [6559213] rados/upgrade/parallel/{0-random-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:18:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559213/ [6559214] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559214/ [6559215] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/repair_test} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559215/ [6559216] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559216/ [6559217] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:43:44 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559217/ [6559218] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559218/ [6559219] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:31:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559219/ [6559220] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559220/ [6559221] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:32:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559221/ [6559222] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559222/ [6559223] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:34:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559223/ [6559224] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559224/ [6559225] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559225/ [6559226] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559226/ [6559227] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559227/ [6559228] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559228/ [6559229] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559229/ [6559230] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8.stream}} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559230/ [6559231] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559231/ [6559232] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559232/ [6559233] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559233/ [6559234] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 01:05:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559234/ [6559235] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559235/ [6559236] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559236/ [6559237] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559237/ [6559238] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559238/ [6559239] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559239/ [6559240] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:22:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559240/ [6559241] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559241/ [6559242] rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:39:45 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559242/ [6559243] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559243/ [6559244] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559244/ [6559245] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559245/ [6559246] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559246/ [6559247] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:29:44 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559247/ [6559248] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559248/ [6559249] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559249/ [6559250] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559250/ [6559251] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:18 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559251/ [6559252] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559252/ [6559253] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} time: 01:09:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559253/ [6559254] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559254/ [6559255] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559255/ [6559256] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:31:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559256/ [6559257] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559257/ [6559258] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:40:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559258/ [6559259] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559259/ [6559260] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559260/ [6559262] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559262/ [6559263] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559263/ [6559264] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:51:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559264/ [6559265] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559265/ [6559266] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559266/ [6559267] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:36:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559267/ [6559268] rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559268/ [6559269] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559269/ [6559270] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:30 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559270/ [6559271] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559271/ [6559272] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559272/ [6559273] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8.stream} tasks/insights} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559273/ [6559274] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559274/ [6559275] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559275/ [6559276] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:48:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559276/ [6559277] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559277/ [6559278] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:51 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559278/ [6559279] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 02:20:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559279/ [6559280] rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559280/ [6559281] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559281/ [6559282] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559282/ [6559283] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559283/ [6559284] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 04:22:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559284/ [6559285] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:27:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559285/ [6559286] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559286/ [6559287] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:19:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559287/ [6559288] rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:32:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559288/ [6559289] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559289/ [6559290] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559290/ [6559291] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559291/ [6559292] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559292/ [6559293] rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559293/ [6559294] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559294/ [6559295] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559295/ [6559296] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559296/ [6559297] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559297/ [6559298] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559298/ [6559299] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559299/ [6559300] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:36:18 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559300/ [6559301] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559301/ [6559302] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:42:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559302/ [6559303] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559303/ [6559304] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559304/ [6559305] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559305/ [6559306] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559306/ [6559307] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559307/ [6559308] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:23:53 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559308/ [6559309] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559309/ [6559310] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559310/ [6559311] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559311/ [6559312] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559312/ [6559313] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559313/ [6559314] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} time: 00:22:30 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559314/ [6559315] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559315/ [6559317] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559317/ [6559318] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559318/ [6559319] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559319/ [6559320] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:02:10 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559320/ [6559321] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559321/ [6559322] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:31:09 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559322/ [6559323] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 01:03:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559323/ [6559324] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559324/ [6559325] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559325/ [6559326] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:37:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559326/ [6559327] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559327/ [6559328] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559328/ [6559329] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559329/ [6559330] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:22:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559330/ [6559331] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559331/ [6559332] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:31:22 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559332/ [6559333] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559333/ [6559334] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559334/ [6559335] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559335/ [6559336] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559336/ [6559337] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559337/ [6559338] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559338/ [6559339] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:31:04 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559339/ [6559340] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559340/ [6559341] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:40:26 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559341/ [6559342] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559342/ [6559343] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559343/ [6559344] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:04:36 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559344/ [6559345] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559345/ [6559346] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 02:21:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559346/ [6559347] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559347/ [6559348] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:21:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559348/ [6559349] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559349/ [6559350] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559350/ [6559351] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559351/ [6559352] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559352/ [6559353] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559353/ [6559354] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559354/ [6559355] rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:00:59 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559355/ [6559356] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559356/ [6559357] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559357/ [6559358] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559358/ [6559359] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:33:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559359/ [6559360] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/prometheus} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559360/ [6559361] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 01:03:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559361/ [6559362] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:27:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559362/ [6559363] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:34:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559363/ [6559364] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559364/ [6559365] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559365/ [6559366] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559366/ [6559367] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559367/ [6559368] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/1.7.0} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559368/ [6559369] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559369/ [6559371] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559371/ [6559372] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559372/ [6559373] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559373/ [6559374] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_with_skews} time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559374/ [6559375] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559375/ [6559377] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 03:10:16 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559377/ [6559378] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559378/ [6559379] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559379/ [6559380] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:24:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559380/ [6559381] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559381/ [6559382] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:54 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559382/ [6559383] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} time: 01:07:21 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559383/ [6559384] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559384/ [6559385] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:25 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559385/ [6559386] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8.stream}} time: 00:31:11 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559386/ [6559387] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559387/ [6559388] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559388/ [6559389] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559389/ [6559390] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559390/ [6559391] rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:43:30 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559391/ [6559392] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/workunits} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559392/ [6559393] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559393/ [6559394] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559394/ [6559395] rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559395/ [6559396] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:40:12 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559396/ [6559397] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559397/ [6559398] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559398/ [6559399] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559399/ [6559400] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:37:55 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559400/ [6559401] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:45:50 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559401/ [6559402] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559402/ [6559403] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559403/ [6559404] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559404/ [6559405] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/snaps-few-objects} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559405/ [6559406] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559406/ [6559407] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559407/ [6559408] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559408/ [6559409] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559409/ [6559410] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559410/ [6559411] rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:42:10 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559411/ [6559412] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:23:05 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559412/ [6559413] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559413/ [6559414] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:47:33 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559414/ [6559415] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559415/ [6559416] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559416/ [6559417] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559417/ [6559418] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:10:56 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559418/ [6559419] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559419/ [6559420] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559420/ [6559421] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559421/ [6559422] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:31:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559422/ [6559423] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559423/ [6559424] rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559424/ [6559425] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:30:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559425/ [6559426] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559426/ [6559427] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559427/ [6559428] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:19 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559428/ [6559429] rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559429/ [6559430] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559430/ [6559431] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559431/ [6559432] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:30:54 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559432/ [6559433] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} time: 00:28:18 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559433/ [6559434] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559434/ [6559435] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:43:27 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559435/ [6559436] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:13 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559436/ [6559437] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:38 info: http://pulpito.ceph.com/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559437/