2022-03-04T05:04:49.731 INFO:root:teuthology version: 1.1.0-eeaeee38 2022-03-04T05:04:49.733 INFO:teuthology.results:subset: '19062/100000' 2022-03-04T05:04:49.733 INFO:teuthology.results:seed: '1021' 2022-03-06T13:34:05.447 INFO:root:teuthology version: 1.1.0-eeaeee38 2022-03-06T13:34:05.503 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-06T19:48:39.790 INFO:teuthology.results:Tests finished! gathering results... 2022-03-06T19:49:07.870 INFO:scrape:Found 309 jobs 2022-03-06T19:49:09.751 INFO:scrape:Found 5 distinct failure reasons 2022-03-06T19:49:09.753 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0242368c2e5127183075788c21e28b3cc072f95b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2022-03-06T19:49:09.754 INFO:scrape:1 jobs: ['6709193'] 2022-03-06T19:49:09.754 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/connectivity', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/sync', 'workloads/rados_api_tests}'] 2022-03-06T19:49:09.755 INFO:scrape: 2022-03-06T19:49:09.755 INFO:scrape:Dead: b'2022-03-04T15:46:37.451 DEBUG:teuthology.exit:Finished running handlers' 2022-03-06T19:49:09.756 INFO:scrape:5 jobs: ['6709044', '6709060', '6709201', '6709120', '6708968'] 2022-03-06T19:49:09.756 INFO:scrape:suites intersection: [] 2022-03-06T19:49:09.757 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/{fixed-2', 'd-thrash/default/{default', 'k8s/1.21', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'net/calico', 'net/flannel', 'net/host', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/verify/{centos_latest', 'rook/1.7.2}', 'rook/master}', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-03-06T19:49:09.757 INFO:scrape: 2022-03-06T19:49:09.757 INFO:scrape:Failure: reached maximum tries (120) after waiting for 120 seconds 2022-03-06T19:49:09.758 INFO:scrape:1 jobs: ['6709068'] 2022-03-06T19:49:09.758 INFO:scrape:suites: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'rados/cephadm/smoke/{0-distro/ubuntu_20.04', 'start}'] 2022-03-06T19:49:09.759 INFO:scrape: 2022-03-06T19:49:09.759 INFO:scrape:Failure: Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0242368c2e5127183075788c21e28b3cc072f95b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 556fdd6a-9bfa-11ec-8c35-001a4aab830c -- ceph mon dump -f json' 2022-03-06T19:49:09.760 INFO:scrape:1 jobs: ['6709140'] 2022-03-06T19:49:09.760 INFO:scrape:suites: ['0-nvme-loop', 'agent/off', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'start}'] 2022-03-06T19:49:09.761 INFO:scrape: 2022-03-06T19:49:09.761 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0242368c2e5127183075788c21e28b3cc072f95b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh' 2022-03-06T19:49:09.762 INFO:scrape:1 jobs: ['6709128'] 2022-03-06T19:49:09.762 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/scrub}'] 2022-03-06T19:49:09.763 INFO:scrape: 2022-03-06T19:49:09.772 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/ failed: 4 dead: 5 running: 0 waiting: 0 queued: 0 passed: 300 Fail ================================================================= [6709068] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:27:40 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709068/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0c85754b4224ce49c97b89bf95177cc reached maximum tries (120) after waiting for 120 seconds [6709128] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} ----------------------------------------------------------------- time: 02:00:12 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709128/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709128/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb4d9fcb3a614909a12c68037688aab0 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0242368c2e5127183075788c21e28b3cc072f95b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [6709140] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709140/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc47098c681a41a3a56cacee1f5b7279 Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:0242368c2e5127183075788c21e28b3cc072f95b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 556fdd6a-9bfa-11ec-8c35-001a4aab830c -- ceph mon dump -f json' [6709193] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709193/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61372e0e14984bdca2216c45915bc087 Command failed (workunit test rados/test.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0242368c2e5127183075788c21e28b3cc072f95b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [6708968] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708968/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708968/ hit max job timeout [6709044] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709044/ hit max job timeout [6709060] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709060/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709060/ hit max job timeout [6709120] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709120/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709120/ hit max job timeout [6709201] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709201/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709201/ hit max job timeout Pass ================================================================= [6708943] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708943/ [6708944] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708944/ [6708945] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708945/ [6708946] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:21:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708946/ [6708947] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:32:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708947/ [6708948] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708948/ [6708949] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708949/ [6708950] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708950/ [6708951] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708951/ [6708952] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708952/ [6708953] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708953/ [6708954] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708954/ [6708955] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708955/ [6708956] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:27:34 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708956/ [6708957] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708957/ [6708958] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708958/ [6708959] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708959/ [6708960] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708960/ [6708961] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708961/ [6708962] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708962/ [6708963] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:23:14 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708963/ [6708964] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:24:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708964/ [6708965] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708965/ [6708966] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:52:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708966/ [6708967] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/crash} time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708967/ [6708969] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708969/ [6708970] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708970/ [6708971] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708971/ [6708972] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:45 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708972/ [6708973] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:23:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708973/ [6708974] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708974/ [6708975] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708975/ [6708976] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708976/ [6708977] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708977/ [6708978] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:35:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708978/ [6708979] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:17:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708979/ [6708980] rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708980/ [6708981] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708981/ [6708982] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708982/ [6708983] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708983/ [6708984] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708984/ [6708985] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708985/ [6708986] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708986/ [6708987] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708987/ [6708988] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708988/ [6708989] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:53:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708989/ [6708990] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708990/ [6708991] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708991/ [6708992] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708992/ [6708993] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708993/ [6708994] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:47:26 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708994/ [6708995] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708995/ [6708996] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708996/ [6708997] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708997/ [6708998] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:28:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708998/ [6708999] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6708999/ [6709000] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709000/ [6709001] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709001/ [6709002] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709002/ [6709003] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709003/ [6709004] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709004/ [6709005] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709005/ [6709006] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709006/ [6709007] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:47:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709007/ [6709008] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/dashboard} time: 01:12:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709008/ [6709009] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709009/ [6709010] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:23 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709010/ [6709011] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:38:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709011/ [6709012] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709012/ [6709013] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709013/ [6709014] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709014/ [6709015] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709015/ [6709016] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709016/ [6709017] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:36:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709017/ [6709018] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709018/ [6709019] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709019/ [6709020] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:51:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709020/ [6709021] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709021/ [6709022] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709022/ [6709023] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709023/ [6709024] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709024/ [6709025] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 01:10:20 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709025/ [6709026] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709026/ [6709027] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 01:12:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709027/ [6709028] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709028/ [6709029] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:04:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709029/ [6709030] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709030/ [6709031] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709031/ [6709032] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709032/ [6709033] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709033/ [6709034] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709034/ [6709035] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:20:41 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709035/ [6709036] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:37:32 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709036/ [6709037] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:33:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709037/ [6709038] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:02:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709038/ [6709039] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709039/ [6709040] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709040/ [6709041] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709041/ [6709042] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:43:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709042/ [6709043] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709043/ [6709045] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709045/ [6709046] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709046/ [6709047] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709047/ [6709048] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709048/ [6709049] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709049/ [6709050] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:03 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709050/ [6709051] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709051/ [6709052] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:41 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709052/ [6709053] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709053/ [6709054] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709054/ [6709055] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709055/ [6709056] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709056/ [6709057] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} time: 04:30:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709057/ [6709058] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709058/ [6709059] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709059/ [6709061] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709061/ [6709062] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:33:57 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709062/ [6709063] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709063/ [6709064] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709064/ [6709065] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:21:39 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709065/ [6709066] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709066/ [6709067] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:30:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709067/ [6709069] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709069/ [6709070] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709070/ [6709071] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709071/ [6709072] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709072/ [6709073] rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709073/ [6709074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:26:32 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709074/ [6709075] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709075/ [6709076] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:41 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709076/ [6709077] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:39:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709077/ [6709078] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:19:45 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709078/ [6709079] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709079/ [6709080] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:44:21 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709080/ [6709081] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:44:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709081/ [6709082] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:34 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709082/ [6709083] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:36:32 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709083/ [6709084] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709084/ [6709085] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709085/ [6709086] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:24:21 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709086/ [6709087] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709087/ [6709088] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709088/ [6709089] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709089/ [6709090] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709090/ [6709091] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709091/ [6709092] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709092/ [6709093] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709093/ [6709094] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709094/ [6709095] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709095/ [6709096] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:13:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709096/ [6709097] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709097/ [6709098] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:32:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709098/ [6709099] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709099/ [6709100] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709100/ [6709101] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:34:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709101/ [6709102] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709102/ [6709103] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709103/ [6709104] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709104/ [6709105] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:31:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709105/ [6709106] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 02:19:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709106/ [6709107] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709107/ [6709108] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709108/ [6709109] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709109/ [6709110] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709110/ [6709111] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709111/ [6709112] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709112/ [6709113] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 01:38:57 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709113/ [6709114] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:41:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709114/ [6709115] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709115/ [6709116] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709116/ [6709117] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709117/ [6709118] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:32:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709118/ [6709119] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:27:46 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709119/ [6709121] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709121/ [6709122] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709122/ [6709123] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709123/ [6709124] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709124/ [6709125] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709125/ [6709126] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709126/ [6709127] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709127/ [6709129] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:02:52 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709129/ [6709130] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709130/ [6709131] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709131/ [6709132] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709132/ [6709133] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709133/ [6709134] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709134/ [6709135] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709135/ [6709136] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:27:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709136/ [6709137] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709137/ [6709138] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:46 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709138/ [6709139] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709139/ [6709141] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:34:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709141/ [6709142] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 01:09:37 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709142/ [6709143] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709143/ [6709144] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709144/ [6709145] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709145/ [6709146] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709146/ [6709147] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 01:05:12 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709147/ [6709148] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709148/ [6709149] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:17 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709149/ [6709150] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709150/ [6709151] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709151/ [6709152] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709152/ [6709153] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709153/ [6709154] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709154/ [6709155] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:35:13 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709155/ [6709156] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709156/ [6709157] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709157/ [6709158] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709158/ [6709159] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:12:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709159/ [6709160] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709160/ [6709161] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:23:58 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709161/ [6709162] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709162/ [6709163] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709163/ [6709164] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:49 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709164/ [6709165] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:01 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709165/ [6709166] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709166/ [6709167] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709167/ [6709168] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:51:40 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709168/ [6709169] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:21:10 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709169/ [6709170] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 00:54:48 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709170/ [6709171] rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709171/ [6709172] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:24:03 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709172/ [6709173] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709173/ [6709174] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709174/ [6709175] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709175/ [6709176] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709176/ [6709177] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:56 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709177/ [6709178] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709178/ [6709179] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709179/ [6709180] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709180/ [6709181] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709181/ [6709182] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709182/ [6709183] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709183/ [6709184] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 02:20:07 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709184/ [6709185] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709185/ [6709186] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709186/ [6709187] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709187/ [6709188] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:32:49 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709188/ [6709189] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709189/ [6709190] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709190/ [6709191] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709191/ [6709192] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709192/ [6709194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709194/ [6709195] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709195/ [6709196] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709196/ [6709197] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:43 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709197/ [6709198] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709198/ [6709199] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709199/ [6709200] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709200/ [6709202] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709202/ [6709203] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709203/ [6709204] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709204/ [6709205] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709205/ [6709206] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:33:07 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709206/ [6709207] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709207/ [6709208] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709208/ [6709209] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:56 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709209/ [6709210] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709210/ [6709211] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709211/ [6709212] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709212/ [6709213] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709213/ [6709214] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709214/ [6709215] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:50:49 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709215/ [6709216] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709216/ [6709217] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709217/ [6709218] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:54 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709218/ [6709219] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709219/ [6709220] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709220/ [6709221] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709221/ [6709222] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:10 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709222/ [6709223] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:46:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709223/ [6709224] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709224/ [6709225] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:40:52 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709225/ [6709226] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} time: 00:24:20 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709226/ [6709227] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:28 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709227/ [6709228] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709228/ [6709229] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709229/ [6709230] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709230/ [6709231] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709231/ [6709232] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:38:19 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709232/ [6709233] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709233/ [6709234] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/failover} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709234/ [6709235] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709235/ [6709236] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709236/ [6709237] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709237/ [6709238] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709238/ [6709239] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709239/ [6709240] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709240/ [6709241] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709241/ [6709242] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709242/ [6709243] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:58:14 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709243/ [6709244] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:26:51 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709244/ [6709245] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709245/ [6709246] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:24:25 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709246/ [6709247] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709247/ [6709248] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:15 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709248/ [6709249] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:45:26 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709249/ [6709250] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709250/ [6709251] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2022-02-27_07:01:03-rados-master-distro-default-smithi/6709251/