2021-11-17T05:50:11.239 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-17T05:50:11.240 INFO:teuthology.results:subset: '30183/100000' 2021-11-17T05:50:11.241 INFO:teuthology.results:seed: '6007' 2021-11-18T00:52:35.467 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-18T00:52:35.501 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-18T12:08:42.684 INFO:teuthology.results:Tests finished! gathering results... 2021-11-18T12:09:19.451 INFO:scrape:Found 400 jobs 2021-11-18T12:09:25.837 INFO:scrape:Found 10 distinct failure reasons 2021-11-18T12:09:25.838 INFO:scrape:Failure: Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) 2021-11-18T12:09:25.839 INFO:scrape:2 jobs: ['6502942', '6502741'] 2021-11-18T12:09:25.839 INFO:scrape:suites intersection: ['debug/mgr', 'rados/mgr/{clusters/{2-node-mgr}', 'tasks/prometheus}'] 2021-11-18T12:09:25.840 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{filestore-xfs}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/prometheus}'] 2021-11-18T12:09:25.840 INFO:scrape: 2021-11-18T12:09:25.840 INFO:scrape:Failure: Command failed on gibba010 with status 5: 'sudo systemctl stop ceph-224e4bd8-479f-11ec-8c2c-001a4aab830c@mon.a' 2021-11-18T12:09:25.841 INFO:scrape:7 jobs: ['6502818', '6502932', '6502704', '6502874', '6502760', '6503046', '6502986'] 2021-11-18T12:09:25.841 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_latest}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2021-11-18T12:09:25.842 INFO:scrape:suites union: ['1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-install/pacific', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_latest}', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2021-11-18T12:09:25.842 INFO:scrape: 2021-11-18T12:09:25.843 INFO:scrape:Failure: Command failed on gibba010 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes' 2021-11-18T12:09:25.843 INFO:scrape:2 jobs: ['6502909', '6503012'] 2021-11-18T12:09:25.844 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-18T12:09:25.844 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-18T12:09:25.845 INFO:scrape: 2021-11-18T12:09:25.845 INFO:scrape:Dead: b'2021-11-17T18:43:37.138 DEBUG:teuthology.exit:Finished running handlers' 2021-11-18T12:09:25.845 INFO:scrape:8 jobs: ['6502713', '6502864', '6503066', '6502962', '6502810', '6502765', '6502943', '6502709'] 2021-11-18T12:09:25.846 INFO:scrape:suites intersection: [] 2021-11-18T12:09:25.846 INFO:scrape:suites union: ['1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '3-upgrade-with-workload', '3-verify}', '4-final}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'mon_election/classic', 'osd}', 'overrides/{pg-warn', 'rados', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'roles', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/{0-v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-18T12:09:25.847 INFO:scrape: 2021-11-18T12:09:25.847 INFO:scrape:Failure: 2021-11-18T12:09:25.848 INFO:scrape:1 jobs: ['6502919'] 2021-11-18T12:09:25.848 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton/{all/ec-inconsistent-hinfo', 'supported-random-distro$/{centos_8}}'] 2021-11-18T12:09:25.849 INFO:scrape: 2021-11-18T12:09:25.849 INFO:scrape:Failure: Test failure: test_ganesha (unittest.loader._FailedTest) 2021-11-18T12:09:25.849 INFO:scrape:2 jobs: ['6502798', '6502998'] 2021-11-18T12:09:25.850 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-bitmap}', 'tasks/dashboard}'] 2021-11-18T12:09:25.850 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-bitmap}', 'tasks/dashboard}'] 2021-11-18T12:09:25.851 INFO:scrape: 2021-11-18T12:09:25.851 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on gibba035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-11-18T12:09:25.852 INFO:scrape:2 jobs: ['6502901', '6502701'] 2021-11-18T12:09:25.852 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'tasks/e2e}'] 2021-11-18T12:09:25.852 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-hybrid}', 'tasks/e2e}'] 2021-11-18T12:09:25.853 INFO:scrape: 2021-11-18T12:09:25.853 INFO:scrape:Failure: Command failed on gibba004 with status 126: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:44cd7c7650ed2227d3597352b00bd2ef65f4388f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 16c02420-47cd-11ec-8c2c-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *'" 2021-11-18T12:09:25.854 INFO:scrape:1 jobs: ['6502930'] 2021-11-18T12:09:25.854 INFO:scrape:suites: ['agent/off', 'distro/centos_8.2_container_tools_3.0', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-nvme-loop', 'start}'] 2021-11-18T12:09:25.855 INFO:scrape: 2021-11-18T12:09:25.855 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2021-11-18T12:09:25.855 INFO:scrape:1 jobs: ['6503062'] 2021-11-18T12:09:25.856 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2021-11-18T12:09:25.856 INFO:scrape: 2021-11-18T12:09:25.857 INFO:scrape:Failure: Command failed (workunit test misc/ver-health.sh) on gibba008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh' 2021-11-18T12:09:25.857 INFO:scrape:1 jobs: ['6502781'] 2021-11-18T12:09:25.858 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/misc}'] 2021-11-18T12:09:25.858 INFO:scrape: 2021-11-18T12:09:25.871 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/ failed: 19 dead: 8 running: 0 waiting: 0 queued: 0 passed: 373 Fail ================================================================= [6502701] rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} ----------------------------------------------------------------- time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502701/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=493d875fea3a4c1dbd311125392e2acc Command failed (workunit test cephadm/test_dashboard_e2e.sh) on gibba045 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6502704] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502704/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23d82b7cb9e24a73b7769e72ef37544c Command failed on gibba008 with status 5: 'sudo systemctl stop ceph- ad36d3a2-4770-11ec-8c2c-001a4aab830c@mon.a' [6502741] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502741/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502741/ sentry: https://sentry.ceph.com/organizations/ceph/?query=328ae05b68ff4807b826863ad16261c5 Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) [6502760] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502760/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=921f4c356b3b465e8f2837e0f423e22b Command failed on gibba001 with status 5: 'sudo systemctl stop ceph-04fb5142-4787-11ec-8c2c-001a4aab830c@mon.a' [6502781] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} ----------------------------------------------------------------- time: 00:51:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502781/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502781/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8385f41507cc45a2b469e93a89df0759 Command failed (workunit test misc/ver-health.sh) on gibba008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh' [6502798] rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/dashboard} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502798/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502798/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd5dc3843a2e41acbd6539a51c15cd46 Test failure: test_ganesha (unittest.loader._FailedTest) [6502818] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502818/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5ec032d9e3440a4b9b74639915a17fa Command failed on gibba010 with status 5: 'sudo systemctl stop ceph-224e4bd8-479f-11ec-8c2c-001a4aab830c@mon.a' [6502874] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502874/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502874/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54078cb3cf5c4b8f805ba7ac59198662 Command failed on gibba008 with status 5: 'sudo systemctl stop ceph-9c63de1e-47b9-11ec-8c2c-001a4aab830c@mon.a' [6502901] rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e} ----------------------------------------------------------------- time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502901/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5d6bb283a1b4041808856156a2f8401 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on gibba035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6502909] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502909/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502909/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0fb32feaa6d547c5a3ae85d95d77d1b0 Command failed on gibba010 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes' [6502919] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 01:24:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502919/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502919/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aec00178a5704497afb70010dee9d979 [6502930] rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502930/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502930/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5efd6745d61242d68682605cfdc61539 Command failed on gibba004 with status 126: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:44cd7c7650ed2227d3597352b00bd2ef65f4388f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 16c02420-47cd-11ec-8c2c-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *'" [6502932] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502932/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502932/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74c0a2ae808f448382994487007b5d0e Command failed on gibba026 with status 5: 'sudo systemctl stop ceph-523ae646-47cf-11ec-8c2c-001a4aab830c@mon.a' [6502942] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502942/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502942/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be634f70a2e64d39a38dc1f2bc8456b0 Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) [6502986] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502986/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502986/ sentry: https://sentry.ceph.com/organizations/ceph/?query=635b7883f64648b1913127cadec1b957 Command failed on gibba004 with status 5: 'sudo systemctl stop ceph- ed78c494-47ec-11ec-8c2c-001a4aab830c@mon.a' [6502998] rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard} ----------------------------------------------------------------- time: 00:21:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502998/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae193d296d744ca39c930aaf6e7fb14f Test failure: test_ganesha (unittest.loader._FailedTest) [6503012] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503012/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503012/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ee9d5523dda4847a1a7cfc931247ec9 Command failed on gibba002 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes' [6503046] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503046/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503046/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3825ceb8cf5641359102a41c4c408251 Command failed on gibba011 with status 5: 'sudo systemctl stop ceph-b806f12a-47fe-11ec-8c2c-001a4aab830c@mon.a' [6503062] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9857d6a8fb9a4205984af4b1e16d4caa 'check osd count' reached maximum tries (90) after waiting for 900 seconds Dead ================================================================= [6502709] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502709/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502709/ hit max job timeout [6502713] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502713/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502713/ hit max job timeout [6502765] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502765/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502765/ hit max job timeout [6502810] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502810/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502810/ hit max job timeout [6502864] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502864/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502864/ hit max job timeout [6502943] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502943/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502943/ hit max job timeout [6502962] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502962/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502962/ hit max job timeout [6503066] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503066/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503066/ hit max job timeout Pass ================================================================= [6502689] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502689/ [6502690] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502690/ [6502691] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:29:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502691/ [6502692] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502692/ [6502693] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502693/ [6502694] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502694/ [6502695] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502695/ [6502696] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502696/ [6502697] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502697/ [6502698] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502698/ [6502699] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502699/ [6502700] rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502700/ [6502702] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502702/ [6502703] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502703/ [6502705] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_nfs} time: 00:21:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502705/ [6502706] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502706/ [6502707] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502707/ [6502708] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:38:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502708/ [6502710] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502710/ [6502711] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:05:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502711/ [6502712] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502712/ [6502714] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502714/ [6502715] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502715/ [6502716] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/progress} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502716/ [6502717] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/pool-create-delete} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502717/ [6502718] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502718/ [6502719] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502719/ [6502720] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502720/ [6502721] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:00:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502721/ [6502722] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:34:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502722/ [6502723] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_no_skews} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502723/ [6502724] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502724/ [6502725] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:21:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502725/ [6502726] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:34:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502726/ [6502727] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502727/ [6502728] rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502728/ [6502729] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:28:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502729/ [6502730] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502730/ [6502731] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:28:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502731/ [6502732] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 02:06:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502732/ [6502733] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502733/ [6502734] rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/mgr} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502734/ [6502735] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502735/ [6502736] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502736/ [6502737] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502737/ [6502738] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502738/ [6502739] rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:23:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502739/ [6502740] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502740/ [6502742] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502742/ [6502743] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502743/ [6502744] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502744/ [6502745] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502745/ [6502746] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502746/ [6502747] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502747/ [6502748] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:32:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502748/ [6502749] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502749/ [6502750] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502750/ [6502751] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502751/ [6502752] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:32:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502752/ [6502753] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502753/ [6502754] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:25:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502754/ [6502755] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502755/ [6502756] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502756/ [6502757] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502757/ [6502758] rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502758/ [6502759] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502759/ [6502761] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.0} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502761/ [6502762] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502762/ [6502763] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502763/ [6502764] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:49:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502764/ [6502766] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502766/ [6502767] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502767/ [6502768] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502768/ [6502769] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502769/ [6502770] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502770/ [6502771] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:19:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502771/ [6502772] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502772/ [6502773] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502773/ [6502774] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502774/ [6502775] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502775/ [6502776] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502776/ [6502777] rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502777/ [6502778] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502778/ [6502779] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502779/ [6502780] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 01:01:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502780/ [6502782] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502782/ [6502783] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502783/ [6502784] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502784/ [6502785] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502785/ [6502786] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:48:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502786/ [6502787] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502787/ [6502788] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502788/ [6502789] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502789/ [6502790] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502790/ [6502791] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502791/ [6502792] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502792/ [6502793] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:41:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502793/ [6502794] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:31:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502794/ [6502795] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502795/ [6502796] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502796/ [6502797] rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502797/ [6502799] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502799/ [6502800] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502800/ [6502801] rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502801/ [6502802] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502802/ [6502803] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502803/ [6502804] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502804/ [6502805] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:32:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502805/ [6502806] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 01:34:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502806/ [6502807] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502807/ [6502808] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502808/ [6502809] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502809/ [6502811] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502811/ [6502812] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:21:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502812/ [6502813] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502813/ [6502814] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502814/ [6502815] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:30:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502815/ [6502816] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} time: 00:21:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502816/ [6502817] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-radosbench} time: 01:03:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502817/ [6502819] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502819/ [6502820] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502820/ [6502821] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:28:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502821/ [6502822] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502822/ [6502823] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502823/ [6502824] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:04:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502824/ [6502825] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502825/ [6502826] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502826/ [6502827] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502827/ [6502828] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502828/ [6502829] rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502829/ [6502830] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/failover} time: 00:20:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502830/ [6502831] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502831/ [6502832] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:29:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502832/ [6502833] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502833/ [6502834] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502834/ [6502835] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502835/ [6502836] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502836/ [6502837] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502837/ [6502838] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:34:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502838/ [6502839] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:30:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502839/ [6502840] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502840/ [6502841] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502841/ [6502842] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502842/ [6502843] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502843/ [6502844] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502844/ [6502845] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502845/ [6502846] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:33:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502846/ [6502847] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:37:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502847/ [6502848] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502848/ [6502849] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502849/ [6502850] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502850/ [6502851] rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502851/ [6502852] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502852/ [6502853] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:19:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502853/ [6502854] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:05:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502854/ [6502855] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502855/ [6502856] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502856/ [6502857] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502857/ [6502858] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502858/ [6502859] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502859/ [6502860] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/flannel rook/master} time: 00:31:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502860/ [6502861] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502861/ [6502862] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs} time: 00:20:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502862/ [6502863] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:22:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502863/ [6502865] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502865/ [6502866] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502866/ [6502867] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502867/ [6502868] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502868/ [6502869] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502869/ [6502870] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502870/ [6502871] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 04:10:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502871/ [6502872] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502872/ [6502873] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502873/ [6502875] rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502875/ [6502876] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:21:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502876/ [6502877] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502877/ [6502878] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:27:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502878/ [6502879] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502879/ [6502880] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502880/ [6502881] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502881/ [6502882] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502882/ [6502883] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502883/ [6502884] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:44:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502884/ [6502885] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502885/ [6502886] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502886/ [6502887] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8.stream} tasks/module_selftest} time: 00:29:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502887/ [6502888] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502888/ [6502889] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502889/ [6502890] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502890/ [6502891] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502891/ [6502892] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502892/ [6502893] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} time: 02:06:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502893/ [6502894] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502894/ [6502895] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502895/ [6502896] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:28:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502896/ [6502897] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502897/ [6502898] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502898/ [6502899] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502899/ [6502900] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502900/ [6502902] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502902/ [6502903] rados/cephadm/smoke/{0-nvme-loop agent/on distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502903/ [6502904] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502904/ [6502905] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502905/ [6502906] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502906/ [6502907] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502907/ [6502908] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502908/ [6502910] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502910/ [6502911] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:02:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502911/ [6502912] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502912/ [6502913] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502913/ [6502914] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502914/ [6502915] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/progress} time: 00:30:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502915/ [6502916] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502916/ [6502917] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502917/ [6502918] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502918/ [6502920] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:46:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502920/ [6502921] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_with_skews} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502921/ [6502922] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502922/ [6502923] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502923/ [6502924] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502924/ [6502925] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502925/ [6502926] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502926/ [6502927] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502927/ [6502928] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502928/ [6502929] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} time: 02:13:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502929/ [6502931] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:15:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502931/ [6502933] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502933/ [6502934] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502934/ [6502935] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_adoption} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502935/ [6502936] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:18:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502936/ [6502937] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502937/ [6502938] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:21:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502938/ [6502939] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502939/ [6502940] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502940/ [6502941] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:20:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502941/ [6502944] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502944/ [6502945] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502945/ [6502946] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:28:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502946/ [6502947] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:59:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502947/ [6502948] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:30:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502948/ [6502949] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 01:51:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502949/ [6502950] rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502950/ [6502951] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502951/ [6502952] rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502952/ [6502953] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/pool-create-delete} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502953/ [6502954] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502954/ [6502955] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502955/ [6502956] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:36:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502956/ [6502957] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502957/ [6502958] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502958/ [6502959] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/host rook/1.7.0} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502959/ [6502960] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502960/ [6502961] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 02:12:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502961/ [6502963] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 01:32:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502963/ [6502964] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502964/ [6502965] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:25:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502965/ [6502966] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502966/ [6502967] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502967/ [6502968] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502968/ [6502969] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502969/ [6502970] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:41:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502970/ [6502971] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502971/ [6502972] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502972/ [6502973] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/workunits} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502973/ [6502974] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502974/ [6502975] rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502975/ [6502976] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502976/ [6502977] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/cache} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502977/ [6502978] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:28:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502978/ [6502979] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:52:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502979/ [6502980] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502980/ [6502981] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502981/ [6502982] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502982/ [6502983] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502983/ [6502984] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502984/ [6502985] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502985/ [6502987] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502987/ [6502988] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502988/ [6502989] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502989/ [6502990] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502990/ [6502991] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502991/ [6502992] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502992/ [6502993] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502993/ [6502994] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/rados_5925} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502994/ [6502995] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502995/ [6502996] rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502996/ [6502997] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502997/ [6502999] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8.stream} tasks/crash} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6502999/ [6503000] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503000/ [6503001] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503001/ [6503002] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503002/ [6503003] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503003/ [6503004] rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503004/ [6503005] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503005/ [6503006] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503006/ [6503007] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503007/ [6503008] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503008/ [6503009] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503009/ [6503010] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503010/ [6503011] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:21:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503011/ [6503013] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503013/ [6503014] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503014/ [6503015] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503015/ [6503016] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503016/ [6503017] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503017/ [6503018] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503018/ [6503019] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503019/ [6503020] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} tasks/rados_stress_watch} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503020/ [6503021] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:37:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503021/ [6503022] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503022/ [6503023] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503023/ [6503024] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503024/ [6503025] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503025/ [6503026] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503026/ [6503027] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503027/ [6503028] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503028/ [6503029] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:35:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503029/ [6503030] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:27:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503030/ [6503031] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/failover} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503031/ [6503032] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503032/ [6503033] rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503033/ [6503034] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503034/ [6503035] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503035/ [6503036] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503036/ [6503037] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503037/ [6503038] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:20:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503038/ [6503039] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503039/ [6503040] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503040/ [6503041] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:27:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503041/ [6503042] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:43:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503042/ [6503043] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 01:01:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503043/ [6503044] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503044/ [6503045] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503045/ [6503047] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:47:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503047/ [6503048] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503048/ [6503049] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:07:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503049/ [6503050] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503050/ [6503051] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:47:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503051/ [6503052] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/rados_striper} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503052/ [6503053] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503053/ [6503054] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503054/ [6503055] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/radosbench} time: 01:09:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503055/ [6503056] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503056/ [6503057] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 01:32:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503057/ [6503058] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:34:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503058/ [6503059] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503059/ [6503060] rados/cephadm/smoke/{0-nvme-loop agent/on distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503060/ [6503061] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503061/ [6503063] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503063/ [6503064] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503064/ [6503065] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503065/ [6503067] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503067/ [6503068] rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503068/ [6503069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503069/ [6503070] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8.stream}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503070/ [6503071] rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503071/ [6503072] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503072/ [6503073] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503073/ [6503074] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:39:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503074/ [6503075] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_adoption} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503075/ [6503076] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503076/ [6503077] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503077/ [6503078] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503078/ [6503079] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503079/ [6503080] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503080/ [6503081] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:31:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503081/ [6503082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:18:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503082/ [6503083] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503083/ [6503084] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503084/ [6503085] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:42:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503085/ [6503086] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503086/ [6503087] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:34:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503087/ [6503088] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_07:01:03-rados-master-distro-default-gibba/6503088/